-- Logs begin at Mon 2022-08-29 23:00:56 UTC, end at Mon 2022-08-29 23:59:57 UTC. -- Aug 29 23:26:59.046908 dv-cinder-855041-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 29 23:26:59.054883 dv-cinder-855041-2-smb devstack@keystone.service[81680]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 23:26:59 2022] *** Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: nodename: dv-cinder-855041-2-smb Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: machine: x86_64 Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: clock source: unix Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: pcre jit disabled Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: detected number of CPU cores: 4 Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: current working directory: / Aug 29 23:26:59.056922 dv-cinder-855041-2-smb devstack@keystone.service[81680]: detected binary path: /usr/bin/uwsgi-core Aug 29 23:26:59.057624 dv-cinder-855041-2-smb devstack@keystone.service[81680]: your processes number limit is 47680 Aug 29 23:26:59.057624 dv-cinder-855041-2-smb devstack@keystone.service[81680]: your memory page size is 4096 bytes Aug 29 23:26:59.057624 dv-cinder-855041-2-smb devstack@keystone.service[81680]: detected max file descriptor number: 2048 Aug 29 23:26:59.057624 dv-cinder-855041-2-smb devstack@keystone.service[81680]: lock engine: pthread robust mutexes Aug 29 23:26:59.057624 dv-cinder-855041-2-smb devstack@keystone.service[81680]: thunder lock: enabled Aug 29 23:26:59.057624 dv-cinder-855041-2-smb devstack@keystone.service[81680]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 29 23:26:59.061391 dv-cinder-855041-2-smb devstack@keystone.service[81680]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 23:26:59.097473 dv-cinder-855041-2-smb devstack@keystone.service[81680]: Python main interpreter initialized at 0x56341159f9c0 Aug 29 23:26:59.097473 dv-cinder-855041-2-smb devstack@keystone.service[81680]: python threads support enabled Aug 29 23:26:59.097473 dv-cinder-855041-2-smb devstack@keystone.service[81680]: your server socket listen backlog is limited to 100 connections Aug 29 23:26:59.097473 dv-cinder-855041-2-smb devstack@keystone.service[81680]: your mercy for graceful operations on workers is 90 seconds Aug 29 23:26:59.097878 dv-cinder-855041-2-smb devstack@keystone.service[81680]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 23:26:59.097960 dv-cinder-855041-2-smb devstack@keystone.service[81680]: *** Operational MODE: preforking *** Aug 29 23:26:59.098235 dv-cinder-855041-2-smb devstack@keystone.service[81680]: *** uWSGI is running in multiple interpreter mode *** Aug 29 23:26:59.098235 dv-cinder-855041-2-smb devstack@keystone.service[81680]: spawned uWSGI master process (pid: 81680) Aug 29 23:26:59.098453 dv-cinder-855041-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 29 23:26:59.099558 dv-cinder-855041-2-smb devstack@keystone.service[81680]: spawned uWSGI worker 1 (pid: 81694, cores: 1) Aug 29 23:26:59.101748 dv-cinder-855041-2-smb devstack@keystone.service[81680]: spawned uWSGI worker 2 (pid: 81695, cores: 1) Aug 29 23:26:59.102974 dv-cinder-855041-2-smb devstack@keystone.service[81680]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 23:27:03.421405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:27:03.421405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: from cryptography.utils import int_from_bytes Aug 29 23:27:03.422188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:27:03.422188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: from cryptography.utils import int_from_bytes Aug 29 23:27:03.422614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:27:03.422614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: from cryptography.utils import int_from_bytes Aug 29 23:27:03.422715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 23:27:03.422715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: from cryptography.utils import int_from_bytes Aug 29 23:27:03.472071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:27:03.472268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:27:03.472397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 23:27:03.472493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] command line args: [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:27:03.472596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 23:27:03.472700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:27:03.472781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] command line args: [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 23:27:03.472847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ================================================================================ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:27:03.473053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 23:27:03.473139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] admin_token = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.473233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ================================================================================ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 23:27:03.473319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_dir = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.473549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.473641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] admin_token = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.473740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] config_source = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.473817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config_dir = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.473920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] debug = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] config_source = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] debug = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.474917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_config_append = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.475936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_config_append = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_dir = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_dir = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.476927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.477964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.478954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.479078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.479208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.479351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.479459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.479741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.479843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] publish_errors = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] publish_errors = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.480959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] standard_threads = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] standard_threads = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.481987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_journal = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_json = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_stderr = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_journal = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] use_syslog = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_json = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.482956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_stderr = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.483120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.483211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] use_syslog = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.483358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 23:27:03.483440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.483612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.483690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.483850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.483927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.484900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.485905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.486859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.487993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.488979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.489958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.490977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.491932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.492874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.493958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.494969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495364 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.495906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.496977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.497936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.498950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.499912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.500871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.501847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.502953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503265 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.503981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.504145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.504221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.504387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.504465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.504624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.505987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.506919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.507901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.508991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.external = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.external = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.509981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.password = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] auth.token = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.password = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.510918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] auth.token = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.511950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.512899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.513904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.514867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.515876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.516853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.517992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.518968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.519992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.520119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.520197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.520421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.521926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.522879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.523858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.524975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.525948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.526997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527871 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.527949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.528895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.529862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.530969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.531988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.532932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.533908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.534835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.535984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.536938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.537929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.538964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.539955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.540923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.541938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.542919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.543850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.544831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545255 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.545862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.546969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.547853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.548907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.549907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.550862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.551840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.552951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.553953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.554984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.555991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.556979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557218 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.557956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.558909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.559852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.560887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:27:03.560979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.561179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.561468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 23:27:03.561614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 23:27:03.591657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.591924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.592097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.592312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.592549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.592779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.600471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.601288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.628218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.628443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.629081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.629320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.681843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.683778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.733383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.733574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.733648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.733751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.892370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.892605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.892822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.892944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.893890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.894111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.916393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.916527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.916610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.916695 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.916837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.916922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.917835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.929093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.929675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.942084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.942322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.942910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.943919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.944020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.944172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 29 23:27:03.960875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.961081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:27:03.961704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.961844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.961989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:27:03.962136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:27:03.962269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.962395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.962525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.962654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 29 23:27:03.962792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.962922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.963050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.963179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.963529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.963796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.972505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.972786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.973058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.973186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.973365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.973508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.973767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.974057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.980384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:03.981063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:03.983314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:03.983599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.983881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:03.984166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.984981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.985939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.986067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.986258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.986540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:03.986815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.010141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.010681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.011610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.011895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.012149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.012432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.016457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.016743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.017027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.017155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.017371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.017669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.023571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.023860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.024033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.024324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.027859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.028181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.028447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.028535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.028737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.028837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.029022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.029107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.029391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.029681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.029966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.030238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.030517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.031043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.031332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.031624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.047517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.047729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.047816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.048010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.052202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.052408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.055346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.055640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.055725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.055936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.060032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.060164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.063199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.063296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.066335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.066522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.066653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.066825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.066941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.067111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.067775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.067944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.068106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.068238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.068428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.068581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.084279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.084396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.084569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.084657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.084838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.084992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.085138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.085276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.092220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.092369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.093763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.093953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.095302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.095470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.095601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.095753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.098225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.098980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.099116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.099268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.099396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.099539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.099673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.099826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.099978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.100111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.111138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.111379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.111612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.111746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.111874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.112973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.113138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.128801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.129283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.131782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.132357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.134687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.135290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.136123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.136739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.137737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.138020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.138257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.138389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.138536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.138818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.144934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.145802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.146477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.146941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.149486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.150667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.158118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.158404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.158623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.158706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.158914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.159196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.166121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.166403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.166665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 29 23:27:04.166755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.166946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.167850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.168948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.169931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.170206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 29 23:27:04.204354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56341159f9c0 pid: 81694 (default app) Aug 29 23:27:04.204815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56341159f9c0 pid: 81695 (default app) Aug 29 23:27:04.207619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacbc8-0bc5-4efc-af6c-d2c62da93749 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:04.207927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacbc8-0bc5-4efc-af6c-d2c62da93749 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:04.208197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacbc8-0bc5-4efc-af6c-d2c62da93749 None None] PATH_INFO: `/v3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:04.212662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Mon Aug 29 23:27:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:10.881505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:10.882059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:10.882059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:10.886563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:10.892610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:10.893161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:10.893161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:10.966691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: INFO dbcounter [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] Registered counter for database keystone Aug 29 23:27:10.986077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG oslo_db.sqlalchemy.engines [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:27:10.992232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writer thread running {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:27:11.177236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG passlib.handlers.bcrypt [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81694) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 23:27:11.177653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG passlib.handlers.bcrypt [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81694) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 23:27:11.236266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:11.237933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:11.366513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 29 23:27:11.839776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:11.908715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: INFO dbcounter [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] Registered counter for database keystone Aug 29 23:27:11.931692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG oslo_db.sqlalchemy.engines [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 23:27:11.937857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writer thread running {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 23:27:12.057873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e230fd-4120-4803-b6a0-120dcc7b6416 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:12.062100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:12.062718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:12.062995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:12.063263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:12.071465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:12.123086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 23:27:12.123423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0cd228-0040-42f4-b7d5-07d6e70c140c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:12.133046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Mon Aug 29 23:27:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:27:12.139545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:12.154908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1370d18-f00b-4985-adf8-51230f39321c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:12.159387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:12.160499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:12.161411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:12.161704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] PATH_INFO: `/v3/projects/7fd422d7b4374b2da837eb380d608b2e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:12.163282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] RBAC: Authorizing `identity:get_project(project_id=7fd422d7b4374b2da837eb380d608b2e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:12.215637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 29 23:27:12.215984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a8fda-9628-4587-b772-3dd7a542aa53 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:12.220582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Mon Aug 29 23:27:12 2022] GET /identity/v3/projects/7fd422d7b4374b2da837eb380d608b2e => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:14.119895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a259f-3bf2-47a7-94b1-7efcba8a4893 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:14.120472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a259f-3bf2-47a7-94b1-7efcba8a4893 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:14.120472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a259f-3bf2-47a7-94b1-7efcba8a4893 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:14.124555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:14.130517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:14.130965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:14.131059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:14.152114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:14.153700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:14.161632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 29 23:27:14.432501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a259f-3bf2-47a7-94b1-7efcba8a4893 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:14.445646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a259f-3bf2-47a7-94b1-7efcba8a4893 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:14.451721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9360c1d-d819-4afe-a8eb-6bb3dccdd50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:14.452314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9360c1d-d819-4afe-a8eb-6bb3dccdd50c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:14.452592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9360c1d-d819-4afe-a8eb-6bb3dccdd50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:14.452861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9360c1d-d819-4afe-a8eb-6bb3dccdd50c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:14.462573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9360c1d-d819-4afe-a8eb-6bb3dccdd50c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:14.464325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9360c1d-d819-4afe-a8eb-6bb3dccdd50c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:14.473037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Mon Aug 29 23:27:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:27:14.478735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:14.487828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af734bfc-0772-4c50-a111-c030de1c782c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:14.492655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf86ee3-0027-46ea-aafd-19183861a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:14.493276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86ee3-0027-46ea-aafd-19183861a841 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:14.493590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86ee3-0027-46ea-aafd-19183861a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:14.493867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf86ee3-0027-46ea-aafd-19183861a841 admin admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:14.495181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf86ee3-0027-46ea-aafd-19183861a841 admin admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:14.497011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf86ee3-0027-46ea-aafd-19183861a841 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:14.498585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Mon Aug 29 23:27:14 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:16.487709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3829f-1271-4dfc-8878-48c97bfbf72a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:16.488219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3829f-1271-4dfc-8878-48c97bfbf72a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:16.488219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3829f-1271-4dfc-8878-48c97bfbf72a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:16.490012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:16.495144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:16.495585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:16.495706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:16.500860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41da2cd-9924-4075-b93b-df7b0adfd3be None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:16.501146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41da2cd-9924-4075-b93b-df7b0adfd3be None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:16.501450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41da2cd-9924-4075-b93b-df7b0adfd3be None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:16.502743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:16.508224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:16.508505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:16.508783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:16.514659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:16.515847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:16.549855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG passlib.handlers.bcrypt [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81695) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 29 23:27:16.550242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG passlib.handlers.bcrypt [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81695) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 29 23:27:16.597122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:16.600060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:16.601692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:16.708657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:16.870330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:16.894258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:16.977848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606d88-30c6-4226-a4dc-4ea46b67da1b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:16.978471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.011658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.012302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.012584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.012906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.025044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:17.033643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:17.034585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:17.036207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:17.041381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.084697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd576a39-49a0-4caa-aaa0-627b2206e960 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.087333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:17.123781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.124552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.124830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.125107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.125329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:17.144649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3db3bc-df5e-4a1f-b0d7-3fd198b3535c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.179019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182780f-245d-4727-968a-66343c755106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.179625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182780f-245d-4727-968a-66343c755106 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.179912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182780f-245d-4727-968a-66343c755106 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.180186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8182780f-245d-4727-968a-66343c755106 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.180890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182780f-245d-4727-968a-66343c755106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:17.181199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182780f-245d-4727-968a-66343c755106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.182670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8182780f-245d-4727-968a-66343c755106 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.194811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:17.195135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.196668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.200155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182780f-245d-4727-968a-66343c755106 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.299767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8182780f-245d-4727-968a-66343c755106 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.300889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:27:17.306525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.309674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:17.334463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.335095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.335401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.335677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.337076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.338585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.340157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:17 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:17.345678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.360414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:17.407744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf2707-f99f-4e48-8c98-cc57c91a4aea None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.444197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.445245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.445559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.445837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.453190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c12ef0-244f-4139-baba-b5cc46fbca09 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.465934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.467411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:27:17.485965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:17.486882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:27:17.487728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:27:17.487728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:27:17.487728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:17.487728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:27:17.488810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.489323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.489632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.489908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.491050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.492526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.492893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.494110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:17.499613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:17.552293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:17.581442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:17.599728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d666c5-454f-4271-9d92-d6b46c4a9514 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.602275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b0dac-8ec5-4f8d-a80a-3553aba20c08 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:17.633990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.634594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.634875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.635145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.635849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:17.636159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.636595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:17.637191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:17.637504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:17.637636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a6748-7dcb-415c-adee-b7dbc985b054 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.637771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:17.638482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.domain.id=default, user.id=77a3dd5bae654f599f156f30a08466b7) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:17.638781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:17.640199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1907e6-ce0f-4893-8c9a-41a68f340c22 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:17.647398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 11/20] 10.222.0.67 () {56 vars in 1322 bytes} [Mon Aug 29 23:27:17 2022] GET /identity/v3/role_assignments?user.id=77a3dd5bae654f599f156f30a08466b7&scope.domain.id=default&role.id=0c9309017d3143658120ff04160bea6f => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:17.655958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 10/21] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:19.834623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936c63-661d-4995-9273-c143ae563916 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:19.835139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936c63-661d-4995-9273-c143ae563916 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:19.835236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936c63-661d-4995-9273-c143ae563916 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:19.837039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 12/22] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:19.846881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c52fa0-f158-436e-86b2-946d5c9e246b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:19.847773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c52fa0-f158-436e-86b2-946d5c9e246b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:19.848878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c52fa0-f158-436e-86b2-946d5c9e246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:19.873854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-88c52fa0-f158-436e-86b2-946d5c9e246b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:19.875420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-88c52fa0-f158-436e-86b2-946d5c9e246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:19.960414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 11/23] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:20.074485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df4e2c-2290-4ad4-a129-e3161d186797 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.074775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df4e2c-2290-4ad4-a129-e3161d186797 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.075043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df4e2c-2290-4ad4-a129-e3161d186797 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.076681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:20.081719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a315bcc-719b-46ea-aa73-605507783bf1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.082244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a315bcc-719b-46ea-aa73-605507783bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.083293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a315bcc-719b-46ea-aa73-605507783bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.107506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8a315bcc-719b-46ea-aa73-605507783bf1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:20.109309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a315bcc-719b-46ea-aa73-605507783bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:20.166670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb2f5-0dbc-4e57-98d0-14b186ebd2c2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.167125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:20.167904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb2f5-0dbc-4e57-98d0-14b186ebd2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.168418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbb2f5-0dbc-4e57-98d0-14b186ebd2c2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.170566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 14/25] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:20.176923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.177496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.177995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.202167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 12/26] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:20.218324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:20.219827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:20.276901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9d60-5963-4a08-94d0-3bd9ea8ea493 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.277242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9d60-5963-4a08-94d0-3bd9ea8ea493 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.277484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef9d60-5963-4a08-94d0-3bd9ea8ea493 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.278822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:20.284216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.284510 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.284783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.320861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:20.322097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:20.359608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 15/28] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:20.363450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:20.457588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 14/29] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:20.534043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:20.572626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bc3e0-7f2f-4f2b-ade1-f5dc0402cc54 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:20.603902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:20.634600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:20.635634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.636146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.636621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.655613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:20.657533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:27:20.679428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:20.680323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:27:20.681123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:27:20.681123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:27:20.681123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:20.688742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 16/30] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:27:20.689977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:20.804946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7be89e-0332-4b9b-aaa3-2797f9c83c67 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:20.815742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:20.854076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4f11d-8e1a-4d86-935b-eac1175cd6c8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:20.860559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:20.862246 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.862731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.863230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.864609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:20.867062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:20.885085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:20.898460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:20.899085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:20.899368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:20.899643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:20.900298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:20.900592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:20.902064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:20.925030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 17/31] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:20.926217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:21.008677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 15/32] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Aug 29 23:27:20 2022] POST /identity/v3/roles => generated 219 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:21.009687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:21.087616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af65da-eaa4-48a9-b02a-9e888ddbe593 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:21.183179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:21.184289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.184695 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.185079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.196347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10aada-b0d5-4e57-b9a9-b5d7a4477701 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:21.206143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:21.214288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:21.215170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:21.215916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:21.218955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 18/33] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:21.219988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:21.242399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:21.243241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.243592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.243972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.244822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:21.247144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:21.270438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 16/34] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Aug 29 23:27:21 2022] POST /identity/v3/roles => generated 225 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:21.271361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:21.288729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:21.321739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:21.364616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c97539-b073-4dfd-bf86-69f196575bb0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:21.408988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b5264-bc6c-405c-a598-1af69cf7e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:21.410119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5264-bc6c-405c-a598-1af69cf7e50a None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.410401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5264-bc6c-405c-a598-1af69cf7e50a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.411219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b5264-bc6c-405c-a598-1af69cf7e50a None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.411907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b5264-bc6c-405c-a598-1af69cf7e50a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:21.413456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b5264-bc6c-405c-a598-1af69cf7e50a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:21.472352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3253c210-58ab-47d0-9c73-b8661d6b41bf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:21.529823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:21.530805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.531309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.531775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.532684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:21.533190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:21.534843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:21.550646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 17/35] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:21.561402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:21.597459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 19/36] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:27:21 2022] POST /identity/v3/projects => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:21.685899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38504fca-cd18-4f0d-a542-f134511ff2ca None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:21.689568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:21.713752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11cb6-e2b7-4d01-9d37-d1fb27ccba21 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.714071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11cb6-e2b7-4d01-9d37-d1fb27ccba21 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.714312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11cb6-e2b7-4d01-9d37-d1fb27ccba21 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.716175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 20/37] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:21.724139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04668-fe0e-4f76-9e16-0e7ea475f324 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.724436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04668-fe0e-4f76-9e16-0e7ea475f324 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.724688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04668-fe0e-4f76-9e16-0e7ea475f324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.748238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-32c04668-fe0e-4f76-9e16-0e7ea475f324 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:21.749859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-32c04668-fe0e-4f76-9e16-0e7ea475f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:21.755969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c0de3-a39f-4354-8ef3-01ed08e2eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:21.756626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0de3-a39f-4354-8ef3-01ed08e2eb40 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.756931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0de3-a39f-4354-8ef3-01ed08e2eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.757255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c0de3-a39f-4354-8ef3-01ed08e2eb40 None admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.763178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0de3-a39f-4354-8ef3-01ed08e2eb40 None admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:21.765189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c0de3-a39f-4354-8ef3-01ed08e2eb40 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:21.767664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 18/38] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:21 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:21.773442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14166e-8a36-4895-834a-446dc943a03e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.773741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14166e-8a36-4895-834a-446dc943a03e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.774018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14166e-8a36-4895-834a-446dc943a03e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.775354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 19/39] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:21.779980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14166e-8a36-4895-834a-446dc943a03e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:21.842099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 21/40] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:21.843363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.843707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.844015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.870079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:21.871326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:21.901236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:21.909718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14166e-8a36-4895-834a-446dc943a03e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:21.950776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:21.951333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:21.951618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:21.951893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:21.953157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:21.954530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 22/41] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:21.954655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:21.956256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 20/42] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:21.962611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:22.065486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0c731-2786-4146-8526-d5797119ec45 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:22.101645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:22.102297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:22.102578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:22.102852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] PATH_INFO: `/v3/domains/default/users/77a3dd5bae654f599f156f30a08466b7/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:22.104860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=77a3dd5bae654f599f156f30a08466b7, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:22.106459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:22.122601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:22.123011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 23/43] 10.222.0.67 () {58 vars in 1361 bytes} [Mon Aug 29 23:27:21 2022] PUT /identity/v3/domains/default/users/77a3dd5bae654f599f156f30a08466b7/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:22.163341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:22.222863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:22.250583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a76d418-ac69-4a0e-b12c-ea6864ac670f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:22.295259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:22.295896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:22.296179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:22.296458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:22.297202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:22.298686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:22.314616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 21/44] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Aug 29 23:27:22 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:27:22.355609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:22.452553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bd701-5935-4bf2-b940-6eeb87635d3f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:22.492462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7c956-f4ca-406d-bb8e-abdc8dd45b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:22.493019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c956-f4ca-406d-bb8e-abdc8dd45b66 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:22.493298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c956-f4ca-406d-bb8e-abdc8dd45b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:22.493641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c956-f4ca-406d-bb8e-abdc8dd45b66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:22.494740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7c956-f4ca-406d-bb8e-abdc8dd45b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:22.496185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7c956-f4ca-406d-bb8e-abdc8dd45b66 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:22.497822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 24/45] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:22.503592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:22.595826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:22.612860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318052f-a01a-4263-b932-f897e5f32e3d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:22.647190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442cea0-4f70-42b7-8792-f162a02fc393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:22.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442cea0-4f70-42b7-8792-f162a02fc393 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:22.648090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442cea0-4f70-42b7-8792-f162a02fc393 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:22.648368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442cea0-4f70-42b7-8792-f162a02fc393 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:22.649045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442cea0-4f70-42b7-8792-f162a02fc393 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:22.650545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442cea0-4f70-42b7-8792-f162a02fc393 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:22.682024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 22/46] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:27:22 2022] POST /identity/v3/projects => generated 312 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:27:24.058693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767ded-8423-49c2-a544-2fffa5b860f2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.059217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767ded-8423-49c2-a544-2fffa5b860f2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.059323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767ded-8423-49c2-a544-2fffa5b860f2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.060590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 25/47] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:24.065849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.066258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.066409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.085574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:24.087359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:24.156459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 23/48] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:24.425804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767ded-8423-49c2-a544-2fffa5b860f2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:24.516830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:24.532968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767ded-8423-49c2-a544-2fffa5b860f2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:24.567668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7deb27-020e-4c65-93e2-241d6d523bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:24.568294 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7deb27-020e-4c65-93e2-241d6d523bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.568660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7deb27-020e-4c65-93e2-241d6d523bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.569019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7deb27-020e-4c65-93e2-241d6d523bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.580591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7deb27-020e-4c65-93e2-241d6d523bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7c7deb27-020e-4c65-93e2-241d6d523bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:24.587176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:24.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:24.589030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 26/49] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:24.594142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:24.613063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8976-cc64-466b-98db-7da7cce9fa1f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.613368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8976-cc64-466b-98db-7da7cce9fa1f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.614251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8976-cc64-466b-98db-7da7cce9fa1f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.615653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 27/50] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:24.620648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.620936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.621208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.640302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:24.641547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:24.659911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:24.696094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c74a0-be6d-46ed-9ab3-c0b8243cf2c8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:24.709912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 28/51] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:24.731064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:24.731674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.731959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.732236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.732905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:24.733213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:24.734652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:24.742745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 24/52] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:24.748383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:24.823037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:24.848928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d602417-d40b-45de-b87f-5a6d2fa7a658 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:24.882522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:24.883159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:24.883445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:24.883730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:24.884882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:24.886393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:24.888005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 29/53] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:24 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:24.893800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:24.974084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:24.994131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195a517-d6fa-4877-82bb-bd379818deb7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:25.020904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:25.030522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:25.031121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:25.031405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:25.031682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:25.032827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:25.034320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:25.036494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 25/54] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:25.042234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:25.083361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc94523-878f-40b7-ae21-45698d3361bb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:25.120931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:25.121614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:25.121898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:25.122171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:25.123383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:25.124896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:25.126870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 30/55] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:25.133081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:25.155221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:25.246908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc7299-df4e-4b35-93a7-41abee9967a6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:25.250325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cfc9b-3550-43b8-9b5c-4cc2fc717296 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:25.282165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdaa50-5938-4adb-b965-3841001faafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:25.282768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdaa50-5938-4adb-b965-3841001faafb None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:25.283053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdaa50-5938-4adb-b965-3841001faafb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:25.283319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdaa50-5938-4adb-b965-3841001faafb None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:25.283967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdaa50-5938-4adb-b965-3841001faafb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:25.284983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:25.285461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdaa50-5938-4adb-b965-3841001faafb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:25.285670 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:25.285961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:25.286238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:25.286978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.domain.id=default, user.id=77a3dd5bae654f599f156f30a08466b7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:25.287292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:25.288728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d74bf-9ed7-43f5-aa79-35c44d62ff48 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:25.298967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 26/56] 10.222.0.67 () {56 vars in 1322 bytes} [Mon Aug 29 23:27:25 2022] GET /identity/v3/role_assignments?user.id=77a3dd5bae654f599f156f30a08466b7&scope.domain.id=default&role.id=0c9309017d3143658120ff04160bea6f => generated 530 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:25.311613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 31/57] 10.222.0.67 () {60 vars in 1140 bytes} [Mon Aug 29 23:27:25 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:27:27.232593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1978531-887d-4f47-8067-d857a827f87b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:27.233079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1978531-887d-4f47-8067-d857a827f87b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:27.233193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1978531-887d-4f47-8067-d857a827f87b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:27.234491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 27/58] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:27.239970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:27.240407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:27.240529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:27.259009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:27.260224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:27.317968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:27.327401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 32/59] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:27.602932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1978531-887d-4f47-8067-d857a827f87b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:27.662750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:27.703484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1978531-887d-4f47-8067-d857a827f87b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:27.740661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fbf10-dcac-4ba0-b2e3-a6267188fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:27.741282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fbf10-dcac-4ba0-b2e3-a6267188fb54 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:27.741593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fbf10-dcac-4ba0-b2e3-a6267188fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:27.741872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fbf10-dcac-4ba0-b2e3-a6267188fb54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:27.742987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fbf10-dcac-4ba0-b2e3-a6267188fb54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:27.744440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fbf10-dcac-4ba0-b2e3-a6267188fb54 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:27.746043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 28/60] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:27.751539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:27.855851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e459ffc-3735-411e-bb5b-6fa273da6cd1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:27.888628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf228f-4cf1-4a8e-9d79-dea1e72275d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:27.889228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf228f-4cf1-4a8e-9d79-dea1e72275d3 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:27.889538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf228f-4cf1-4a8e-9d79-dea1e72275d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:27.889813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf228f-4cf1-4a8e-9d79-dea1e72275d3 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:27.890459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf228f-4cf1-4a8e-9d79-dea1e72275d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:27.891893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf228f-4cf1-4a8e-9d79-dea1e72275d3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:27.919595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 33/61] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:27 2022] POST /identity/v3/users => generated 275 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:30.876832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75145-d255-48db-9cdf-aedda564b3c4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:30.877363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75145-d255-48db-9cdf-aedda564b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:30.877441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd75145-d255-48db-9cdf-aedda564b3c4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:30.878779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 29/62] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:30.884962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689070a-6ec1-4f2c-bd20-d0f6f2be338b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:30.885459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689070a-6ec1-4f2c-bd20-d0f6f2be338b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:30.885648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689070a-6ec1-4f2c-bd20-d0f6f2be338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:30.908067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c689070a-6ec1-4f2c-bd20-d0f6f2be338b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:30.909638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c689070a-6ec1-4f2c-bd20-d0f6f2be338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:30.971687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:30.999132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 34/63] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:31.075144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2b48-43f9-49ac-8190-f458ff84183d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.075767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2b48-43f9-49ac-8190-f458ff84183d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.076272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a2b48-43f9-49ac-8190-f458ff84183d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.077861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 30/64] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:31.083501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68ba2-c850-4d65-8113-c99dca97da9b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.084025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68ba2-c850-4d65-8113-c99dca97da9b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.084510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae68ba2-c850-4d65-8113-c99dca97da9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.111311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-eae68ba2-c850-4d65-8113-c99dca97da9b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:31.112839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eae68ba2-c850-4d65-8113-c99dca97da9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:31.213872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 35/65] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:31.327171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2b48-43f9-49ac-8190-f458ff84183d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:31.412630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa37264-183f-492c-98de-19af754b77eb None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.413270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa37264-183f-492c-98de-19af754b77eb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.413795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa37264-183f-492c-98de-19af754b77eb None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.415355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 36/66] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:31.420543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e8bb-1e1d-4268-ac44-312fb9001784 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.421076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e8bb-1e1d-4268-ac44-312fb9001784 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.421611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9e8bb-1e1d-4268-ac44-312fb9001784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.451489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a2b48-43f9-49ac-8190-f458ff84183d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:31.458723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-57e9e8bb-1e1d-4268-ac44-312fb9001784 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:31.459936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-57e9e8bb-1e1d-4268-ac44-312fb9001784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:31.495925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:31.522658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:31.523302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.523584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.523860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.538617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:31.545689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:31.546581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:31.547336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:31.549306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 37/68] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:31.550816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72482ca-c207-4958-b87b-13df57ecf10d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.551339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72482ca-c207-4958-b87b-13df57ecf10d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.551826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72482ca-c207-4958-b87b-13df57ecf10d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.552190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 31/68] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:31.553515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:31.566694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 38/69] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:31 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:31.568454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.568891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.569269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.595370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:31.596765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:31.634211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:31.669861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 39/70] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:31.670852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:31.689856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534fc55a-7937-4f9f-a9f3-12fb0b344452 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:31.752955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:31.753932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.754423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.754897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.755753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:31.756303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:31.757938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f414f-c58c-466e-8ae6-961fca87568c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:31.766886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 32/71] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:31.768581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369a730-7fc5-4e14-9d9b-afd9fe28b533 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.769062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369a730-7fc5-4e14-9d9b-afd9fe28b533 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.769558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369a730-7fc5-4e14-9d9b-afd9fe28b533 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.771690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 33/72] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:31.773014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369a730-7fc5-4e14-9d9b-afd9fe28b533 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:31.778111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0931c-1e75-4569-bc96-d7becc884de0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:31.814605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3132d-d4ca-47be-8441-5380ed74c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:31.815327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3132d-d4ca-47be-8441-5380ed74c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.815614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3132d-d4ca-47be-8441-5380ed74c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.815892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3132d-d4ca-47be-8441-5380ed74c5e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.827896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3132d-d4ca-47be-8441-5380ed74c5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:31.830562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-11c3132d-d4ca-47be-8441-5380ed74c5e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:31.835099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:31.835944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 40/73] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:31.841834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.842584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.842584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.859676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:31.860875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:31.889636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:31.902990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369a730-7fc5-4e14-9d9b-afd9fe28b533 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:31.945455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 41/74] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:31.945455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:31.946662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:31.947474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:31.947763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:31.948091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:31.966692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:31.968349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:31.974645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 34/75] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:31 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:31.974645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.061985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d49bbc-6949-4bb6-999b-d3cb3bc72873 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.091259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5084ad-9276-4428-9a2b-918d3dadccda None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.099375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.099993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.100278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.100553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.101378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:32.101566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.102063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.102978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.112803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 42/76] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.114480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.131781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.132550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.132837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.133112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.139096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.150355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:32.155386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:32.156232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:32.156976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 35/77] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:27:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:32.158422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.232601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d3266-3af6-44f7-816e-2051b492084f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.264742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934749e-c06e-4c79-9db4-f47a369b6e6a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.267913 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.268524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.268806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.269083 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.298918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.299547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.299830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.300104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.310744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:32.315597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:32.316440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:32.317815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 36/78] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:32.322994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.338845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.340710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.351789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.364313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.426325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad38e7-b7fd-4125-9b22-1642b865e212 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.442455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 43/79] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:32.443300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.460545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.461176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.461481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.461999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.463124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.464611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.466208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 37/80] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.466969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.546389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d753f76-9885-4246-9f1b-3966b003c1f1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.561594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.568546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44e0e6-92ae-440d-af38-39989baaec21 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.570721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.582313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.582917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.583198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.583465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.584122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:32.584421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.585835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.593858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 44/81] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.594639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.607527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.608154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.608430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.608701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.609860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.611306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.612861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 38/82] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.614194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.697904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b13ea1-9a48-412b-89dd-1339a701ebe3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.718237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3535e-21dc-410b-bc68-df0811d24fe7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.731137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.731744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.732028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.732307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.732972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:32.733281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.734700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.743281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 45/83] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.744087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.754062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.754692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.754974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.755252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.756392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.757897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.759489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 39/84] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.760249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.790984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.796754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:32.851111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386f9aa-474c-4f63-8a9b-ef879d5f96c5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.861144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04ac03-10df-4f20-bb0b-ef9b63f82507 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:32.890525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.893286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.893632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.893941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.895190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:32.895745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:32.896028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:32.896303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:32.897472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.898931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.900509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 40/85] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:32.905938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:32.969076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:32.970604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:32.998336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.001580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affb903-bef1-406c-84f4-b15f133b0f47 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.016325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.037078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.037701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.037991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.038269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.038934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.040385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.067083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 41/86] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:32 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:33.068146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.072467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 46/87] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:33.073371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.198001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f07ccc-9679-4bff-b54e-8da6e2c8cfa2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.200289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed6a07-bd0c-4c89-8905-4d58ef3264a1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.240313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.241037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.241322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.241743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.242183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.243141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.243821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.244603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.244603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.244771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.245594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=b89b287edf244e8abe3dd68d5134f421) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:33.245908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.246481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 42/88] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:33.247062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.248745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.260632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 47/89] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/role_assignments?user.id=b89b287edf244e8abe3dd68d5134f421&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=d0ec590bde8e414995f352abf7f10ace => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:33.270091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.279893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.292759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.408413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176b5f7-1412-4cad-9957-3097737aa229 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.417643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572d0f8-e113-4c84-973b-2f4eff4a44b5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.461367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.462828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.463294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.463736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.466410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.467249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.467601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.467942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.469313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.470888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.472619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 48/90] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:33.473656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.553990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.556780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.565822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.593267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493626a-0ad5-4fb8-a862-f536ff7b2e56 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.594506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.632622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.633737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.634205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.634997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.685967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 43/91] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:33.687200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.715455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.717051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.804936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.825207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2b37-d316-40d0-92fe-c3e552879186 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:33.845964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 49/92] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:33.846834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:33.871802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:33.896481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:33.897104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:33.897405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:33.897681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:33.898649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=77a3dd5bae654f599f156f30a08466b7) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:33.899161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:33.900817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:33.907188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 44/93] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/role_assignments?user.id=77a3dd5bae654f599f156f30a08466b7&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:33.908668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:34.059727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827b63-47c5-4c59-90d9-3769cdc501e5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:34.111958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea420f5-7c9b-42f8-984f-7352332130cd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:34.134644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:34.135629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:34.136106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:34.136576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:34.137981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:34.139656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:34.141685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 50/94] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:34.151442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:34.172061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:34.172707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:34.172998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:34.173274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] PATH_INFO: `/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:34.177375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] RBAC: Authorizing `identity:get_project(project_id=4b62dc3ebe6f44778e327b88bcaf135a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:34.177375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:34.178655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 45/95] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:33 2022] GET /identity/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a => generated 312 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:34.186513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:34.259240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:34.277712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:34.326205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce064b-171b-4be8-bb5a-7f88a3bd4497 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:34.381682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:34.382288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:34.382569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:34.382843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:34.383576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=4b62dc3ebe6f44778e327b88bcaf135a, user.id=b89b287edf244e8abe3dd68d5134f421) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:34.383885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:34.385591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91effe-72a2-465c-a72b-a9e8f1be5498 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:34.389128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab13c11-ec10-44f9-9ebe-6959a9d8f443 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:34.401199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 46/96] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:34 2022] GET /identity/v3/role_assignments?user.id=b89b287edf244e8abe3dd68d5134f421&scope.project.id=4b62dc3ebe6f44778e327b88bcaf135a&role.id=d0ec590bde8e414995f352abf7f10ace => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:34.430301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:34.430922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:34.431202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:34.431473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:34.432208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] RBAC: Adding query filter params (role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=b89b287edf244e8abe3dd68d5134f421) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:34.432514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:34.434047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84519bc2-5c5f-435e-8aa7-20d5d06cce27 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:34.440834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 51/97] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:34 2022] GET /identity/v3/role_assignments?user.id=b89b287edf244e8abe3dd68d5134f421&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:35.671223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb9d6-711e-41f2-935c-66cc7bfba48e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:35.672310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb9d6-711e-41f2-935c-66cc7bfba48e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:35.672837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cb9d6-711e-41f2-935c-66cc7bfba48e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:35.674691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 47/98] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:35.681120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94ad9-44df-496d-a64a-d930ec25132e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:35.682100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94ad9-44df-496d-a64a-d930ec25132e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:35.682634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc94ad9-44df-496d-a64a-d930ec25132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:35.702053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-edc94ad9-44df-496d-a64a-d930ec25132e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:35.703689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-edc94ad9-44df-496d-a64a-d930ec25132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:35.794719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 52/99] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:35.921062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3d39-6689-4e3e-8840-27befe7dcb8d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:35.921459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3d39-6689-4e3e-8840-27befe7dcb8d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:35.921647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b3d39-6689-4e3e-8840-27befe7dcb8d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:35.923005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 48/100] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:35.928762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b353ab-bf79-4d46-83d1-887e0577e1cc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:35.929057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b353ab-bf79-4d46-83d1-887e0577e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:35.929336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b353ab-bf79-4d46-83d1-887e0577e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:35.947529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-33b353ab-bf79-4d46-83d1-887e0577e1cc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:35.948724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-33b353ab-bf79-4d46-83d1-887e0577e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:35.986211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:36.025896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 53/101] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:36.143737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0453db-2bd6-412d-ac04-abb434a7c8ff None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:36.143737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0453db-2bd6-412d-ac04-abb434a7c8ff None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:36.143737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0453db-2bd6-412d-ac04-abb434a7c8ff None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:36.143737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 49/102] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:36.149620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:36.149620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:36.149801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:36.176841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:36.178047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:36.271841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 54/103] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:36.352168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0453db-2bd6-412d-ac04-abb434a7c8ff None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:36.500141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0453db-2bd6-412d-ac04-abb434a7c8ff None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:36.521182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:36.527133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:36.536264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:36.536900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:36.537181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:36.537477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:36.548914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:36.554299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:36.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:36.556299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:36.558908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 50/104] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:36.564195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:36.729173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:36.734263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5d672-98e0-4e5b-831e-709e4f8b1533 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:36.757034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3e83-6374-4c84-954a-b108256c50be None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:36.803775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:36.804762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:36.806013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:36.807069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:36.825685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:36.830194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:36.830960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:36.831380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:36.831808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:36.832650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:36.833106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:36.835048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:36.836043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:36.837196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:36.839284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:36.842441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 55/105] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:36.843409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:36.857773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 51/106] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:36.858909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:36.944011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.008191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77900cb-08aa-407b-a112-0cc3503b0d92 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.019821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863eb506-c2f3-4708-845b-1926943d7234 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.046162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.047053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.047468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.047873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.049254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.051580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.053527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 56/107] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:37.054613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.062313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.062941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.063225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.063499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.064175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:37.064479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.065909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe21bd-5043-42d2-a457-3df2e0a331a7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.077596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 52/108] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:37.079147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c31b-dd5c-42c1-bfac-f144babf2668 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.079445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c31b-dd5c-42c1-bfac-f144babf2668 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.079726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06c31b-dd5c-42c1-bfac-f144babf2668 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.080931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 53/109] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:37.085727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06c31b-dd5c-42c1-bfac-f144babf2668 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.096009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.189487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1888cc-7ee7-4e4b-80fe-b806fb489b07 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.204411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06c31b-dd5c-42c1-bfac-f144babf2668 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.207207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.235870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.236884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.237518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.237963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] PATH_INFO: `/v3/users/a7056c200e0a4ed7ae683143340cbd04` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.253708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0d768-d166-43f9-b0c3-75d214e72d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.254449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0d768-d166-43f9-b0c3-75d214e72d8d None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.254715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=a7056c200e0a4ed7ae683143340cbd04)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.254816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0d768-d166-43f9-b0c3-75d214e72d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.255184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0d768-d166-43f9-b0c3-75d214e72d8d None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.255910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0d768-d166-43f9-b0c3-75d214e72d8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.256895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.257515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0d768-d166-43f9-b0c3-75d214e72d8d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.259077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 57/110] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:37 2022] GET /identity/v3/users/a7056c200e0a4ed7ae683143340cbd04 => generated 289 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:37.260166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.293801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 54/111] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:27:37 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:37.295054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.295581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.295929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.334421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:37.335656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:37.412675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.430658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918b9c-ca6b-473f-aeef-8605a61da1a0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.445928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 55/112] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:37.447211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.478813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c689b9-6360-46be-8212-b782be1bcfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.480413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c689b9-6360-46be-8212-b782be1bcfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.480768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c689b9-6360-46be-8212-b782be1bcfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.481133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c689b9-6360-46be-8212-b782be1bcfd8 None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.482418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c689b9-6360-46be-8212-b782be1bcfd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.484016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c689b9-6360-46be-8212-b782be1bcfd8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.488989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 58/113] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:37 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:37.488989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec3d61-3fb9-4555-bdea-fc1397e1ab32 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.488989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec3d61-3fb9-4555-bdea-fc1397e1ab32 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.488989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec3d61-3fb9-4555-bdea-fc1397e1ab32 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.488989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 59/114] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:37.490065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf3cd-88e5-4285-badb-450760266cad None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.490181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf3cd-88e5-4285-badb-450760266cad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.491369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abf3cd-88e5-4285-badb-450760266cad None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.491953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 60/115] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:37.492655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf3cd-88e5-4285-badb-450760266cad None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.567403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.581585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83697-6818-40af-a330-b53f3555b1be None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.619826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.620256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.620542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.620819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.632737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abf3cd-88e5-4285-badb-450760266cad None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:37.676001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c7bcf-463a-4b61-b47a-22b4e87f1cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:37.677077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c7bcf-463a-4b61-b47a-22b4e87f1cbb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.677535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c7bcf-463a-4b61-b47a-22b4e87f1cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.677818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c7bcf-463a-4b61-b47a-22b4e87f1cbb None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.679175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c7bcf-463a-4b61-b47a-22b4e87f1cbb None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.680642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c7bcf-463a-4b61-b47a-22b4e87f1cbb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.685422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 61/116] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:37 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:37.685422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6d4c-d8b5-47a7-b2a2-71f66a1866fe None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.685422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6d4c-d8b5-47a7-b2a2-71f66a1866fe None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.685422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c6d4c-d8b5-47a7-b2a2-71f66a1866fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.703726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d55c6d4c-d8b5-47a7-b2a2-71f66a1866fe None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:37.705088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d55c6d4c-d8b5-47a7-b2a2-71f66a1866fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:37.717845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:37.719493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:37.727666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.785743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 62/117] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:37.787117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:37.787416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:37.787694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:37.811380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:37.819191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:37.821279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:37.829258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 56/118] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:37.834708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.920242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 63/119] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:37.921203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:37.967135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071e9f6-9579-4557-8c24-3e2de9b8cd01 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.031957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.032675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.032963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.033370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/b89b287edf244e8abe3dd68d5134f421/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.038370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb7426167797495c89da5ca88d7a02f3, user_id=b89b287edf244e8abe3dd68d5134f421, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:38.039898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:38.050910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:38.065437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 57/120] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:37 2022] PUT /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/b89b287edf244e8abe3dd68d5134f421/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:38.066067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.076018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff04ce-48cb-4b26-809b-5cfe0696731e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.148118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.149164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.149623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.150097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.165497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:38.170988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:38.171871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:38.172672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:38.178914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 64/121] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:38.179673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.196430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:38.299505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b9d39-d664-4ef9-b568-9f3925e6f898 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.320999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcf28c-f37b-4ac4-a278-b4327863acac None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.344795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.345378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.345744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.346024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.347227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:38.348836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:38.350654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 58/122] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:38.351592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.366611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.367342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.367634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.367914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.380089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:38.384992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:38.385870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:38.386613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 65/123] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:38.387239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.392695 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:38.484094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebf5ba-4362-49f3-a9ea-b4f8d5ddd4b9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.504562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:38.510382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2fed9-3925-4b01-bcd0-44085f97b90c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.543028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.543671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.543952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.544225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.545157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:38.545513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:38.547627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:38.552157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.553160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.553673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.554152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.558948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 59/124] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:38.559649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.568997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:38.574538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:38.575408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:38.576199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:38.578504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 66/125] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:38.579493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.648931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:38.686841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63995209-1ba3-4d46-be5b-5122e09885c8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.697660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb0856-1e4a-4cfb-b75f-410cb08f1e07 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.731224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.731785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.732066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.732339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.733069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] RBAC: Adding query filter params (role.id=4464d6860e5f43449760b1be307f75d8, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=a7056c200e0a4ed7ae683143340cbd04) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:38.733464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:38.734948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:38.749377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 60/126] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/role_assignments?user.id=a7056c200e0a4ed7ae683143340cbd04&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=4464d6860e5f43449760b1be307f75d8 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:38.749377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.749629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:38.749629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:38.749629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:38.750372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:38.751873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:38.751873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:38.758742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:38.778996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 67/127] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:38.779895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:38.820255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:38.949151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b337f-9d70-45d2-ad97-8da3b8c52e4a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:38.994006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df5f37-7c73-4f4b-bbd4-db25359363cb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.014864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.015502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.015786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.016065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.018892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.021149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.022783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 61/128] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.023575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.043521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:39.063153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.063769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.064052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.064329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.065005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:39.065311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.066778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.085874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 68/129] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:27:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.094023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.216798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c062763-4729-497f-a404-2d741ab2243d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.231240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:39.263767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.264410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.264691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.264963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.266176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.267641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.269463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 62/130] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:39 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.270078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.340970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aec57e-2f8a-40e2-93af-789b4e770d9c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.418065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.419062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.419565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.420031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.421430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.423086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.425226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 69/131] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:39 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.426833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.432868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d5f58-88dd-4fdc-b352-d701c7dc4fde None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.471609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.473092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.473597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.474156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.475638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.477324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.479677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 63/132] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:39 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.480652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.505245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:39.533709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:39.553426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb25c-2433-43f1-8181-e6f8c697bb2e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.590257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea3f8b-c937-4306-ac40-f070eb9636d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.590894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3f8b-c937-4306-ac40-f070eb9636d3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.591181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3f8b-c937-4306-ac40-f070eb9636d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.591460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea3f8b-c937-4306-ac40-f070eb9636d3 None admin] PATH_INFO: `/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.591724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7718da1-2226-46fe-9dcd-55735a4deb2e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.592603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3f8b-c937-4306-ac40-f070eb9636d3 None admin] RBAC: Authorizing `identity:get_project(project_id=4b62dc3ebe6f44778e327b88bcaf135a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.594183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea3f8b-c937-4306-ac40-f070eb9636d3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.595829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 70/133] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:39 2022] GET /identity/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.596963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8035ea-deef-4a65-bdc2-db879c1afbae None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.597251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8035ea-deef-4a65-bdc2-db879c1afbae None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.602694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8035ea-deef-4a65-bdc2-db879c1afbae None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.604013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 71/134] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:39.604903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8035ea-deef-4a65-bdc2-db879c1afbae None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.635851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.635851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.635851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.636159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/77a3dd5bae654f599f156f30a08466b7/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.638138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] RBAC: Authorizing `identity:create_grant(project_id=cb7426167797495c89da5ca88d7a02f3, user_id=77a3dd5bae654f599f156f30a08466b7, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.639705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.657291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 64/135] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:39 2022] PUT /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/77a3dd5bae654f599f156f30a08466b7/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:39.665218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.727501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8035ea-deef-4a65-bdc2-db879c1afbae None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.799260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:39.830199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466d877-a4b4-4437-a43f-33a47c5d330d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:39.869745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:39.874066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055f613-2bd1-43b9-8087-e568b4dfdfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.875096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f613-2bd1-43b9-8087-e568b4dfdfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.875096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f613-2bd1-43b9-8087-e568b4dfdfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.875285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055f613-2bd1-43b9-8087-e568b4dfdfd8 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.878067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:39.878713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.879005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.879321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] PATH_INFO: `/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a/users/b89b287edf244e8abe3dd68d5134f421/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.882712 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b62dc3ebe6f44778e327b88bcaf135a, user_id=b89b287edf244e8abe3dd68d5134f421, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.882837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055f613-2bd1-43b9-8087-e568b4dfdfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:39.883397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.883564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055f613-2bd1-43b9-8087-e568b4dfdfd8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:39.885498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 72/136] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:39 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:39.886993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02455-2518-4ecd-8965-13f222e10271 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:39.886993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02455-2518-4ecd-8965-13f222e10271 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:39.887161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b02455-2518-4ecd-8965-13f222e10271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:39.899395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 65/137] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:39 2022] PUT /identity/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a/users/b89b287edf244e8abe3dd68d5134f421/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:39.900107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:39.934584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-49b02455-2518-4ecd-8965-13f222e10271 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:39.935809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-49b02455-2518-4ecd-8965-13f222e10271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:40.046635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfcbc7-fded-4eaa-8e22-1701a9e88219 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:40.114342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286158a-1abd-4b61-8e69-ed153881cf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:40.115455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286158a-1abd-4b61-8e69-ed153881cf0a None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:40.115984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286158a-1abd-4b61-8e69-ed153881cf0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:40.116465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286158a-1abd-4b61-8e69-ed153881cf0a None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/b89b287edf244e8abe3dd68d5134f421/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:40.124145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286158a-1abd-4b61-8e69-ed153881cf0a None admin] RBAC: Authorizing `identity:create_grant(project_id=cb7426167797495c89da5ca88d7a02f3, user_id=b89b287edf244e8abe3dd68d5134f421, role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:40.125964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286158a-1abd-4b61-8e69-ed153881cf0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:40.154744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 66/138] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:39 2022] PUT /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/b89b287edf244e8abe3dd68d5134f421/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:40.179870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 73/139] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:40.250077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc751fe-28cb-4573-a9da-b1b8bf4b613e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:40.250374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc751fe-28cb-4573-a9da-b1b8bf4b613e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:40.250638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc751fe-28cb-4573-a9da-b1b8bf4b613e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:40.251994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 67/140] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:40.258543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:40.258839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:40.259090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:40.281297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:40.282568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:40.366144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 74/141] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:40.679606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc751fe-28cb-4573-a9da-b1b8bf4b613e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:40.714317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:40.803722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc751fe-28cb-4573-a9da-b1b8bf4b613e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:40.848420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:40.849053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:40.849333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:40.849635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:40.854021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:40.855507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:40.857435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 68/142] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:40.862860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:40.882817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:40.982537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:41.021808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:41.027935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee7059-4f39-48dd-a60b-c14df6e96c81 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:41.131312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639db46-a28f-4871-a1db-19fb6fc0e211 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:41.140116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:41.140786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.141494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.141768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.177680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:41.183044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:41.183895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:41.184640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 69/143] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:27:41.192301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:41.219676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf66e-4a2d-40b1-b91d-1cc67ac3d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:41.220971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf66e-4a2d-40b1-b91d-1cc67ac3d646 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.221661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf66e-4a2d-40b1-b91d-1cc67ac3d646 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.223517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf66e-4a2d-40b1-b91d-1cc67ac3d646 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.224401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbf66e-4a2d-40b1-b91d-1cc67ac3d646 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:41.226206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbf66e-4a2d-40b1-b91d-1cc67ac3d646 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:41.263666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 75/144] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:40 2022] POST /identity/v3/users => generated 283 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:41.271271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b22e7-30ce-4470-951a-4f55595169d4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.271918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b22e7-30ce-4470-951a-4f55595169d4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.272406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b22e7-30ce-4470-951a-4f55595169d4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.274050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 76/145] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:41.295235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.295865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.296348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.327801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:41.330780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:41.372120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1d528-11a2-4f5f-9600-36e9543d17dc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:41.417039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:41.417741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.418019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.418317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.420585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:41.420905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:41.422338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:41.435836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 70/146] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:41.442441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:41.479054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:41.492714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 77/147] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:41.580689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047156e-38a1-415f-a92c-8f1714c0ed50 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:41.617233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:41.617897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.618174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.618442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.619568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:41.620995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:41.622599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 71/148] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:41 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:41.628331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:41.666623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:41.758077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22400a88-aa4c-452a-9718-eb2408c4944a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:41.799863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:41.800464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:41.801320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:41.801613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:41.891225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:41.892717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:41.928451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:41.945953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:42.051435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:42.067134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 78/149] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:42.072655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:42.076097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575dbcc1-1839-4b8e-9e54-78d077204ab6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.149208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.150144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.150607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.151046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.177880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:42.183390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:42.184255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:42.185071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 72/150] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:27:42.192985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:42.296288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd072ee8-0787-4e58-9cd6-dc442f11fd92 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.341888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57195c-6507-4995-81ea-a28faf636c33 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.382436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.383066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.383329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.383600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.384279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:42.384581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:42.385995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:42.386710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.387372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.387656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.387932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.394096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:42.395786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 73/151] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:42.396517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:42.398668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 79/152] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:42 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:42.401577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:42.405583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:42.421599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:42.428896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:42.517605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b948b-ac91-443a-88b5-166c0c373e9c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.555563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.556207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.556486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.556756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] PATH_INFO: `/v3/users/a7056c200e0a4ed7ae683143340cbd04` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.557937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] RBAC: Authorizing `identity:get_user(user_id=a7056c200e0a4ed7ae683143340cbd04)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:42.559395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:42.560988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 74/153] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:42 2022] GET /identity/v3/users/a7056c200e0a4ed7ae683143340cbd04 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:42.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:42.594738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe7f05-00fb-483b-9aec-1b76f2e58e6f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.651778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:42.658117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.658759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.659048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.659330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.660159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=b89b287edf244e8abe3dd68d5134f421) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:42.660472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:42.661998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:42.671163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 80/154] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:42 2022] GET /identity/v3/role_assignments?user.id=b89b287edf244e8abe3dd68d5134f421&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=d0ec590bde8e414995f352abf7f10ace => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:42.684024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df2406-8430-4b2f-b9ae-b1f4bfd9689e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.731163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a50f6-4191-465d-8391-eb240899c2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.731813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a50f6-4191-465d-8391-eb240899c2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.732093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a50f6-4191-465d-8391-eb240899c2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.732378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a50f6-4191-465d-8391-eb240899c2d3 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.733553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a50f6-4191-465d-8391-eb240899c2d3 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:42.735020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a50f6-4191-465d-8391-eb240899c2d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:42.736647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 75/155] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:42 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:42.743029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:42.857742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:42.890315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1f609-b72a-4eb2-96ab-6ae9eca41175 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.890638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1f609-b72a-4eb2-96ab-6ae9eca41175 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.890868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1f609-b72a-4eb2-96ab-6ae9eca41175 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.891766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4b6d0-c50d-4bb8-976c-d6bc06a468ac None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:42.892222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 76/156] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:42.898367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f7b66-8277-4244-89a6-66d8e74b16ed None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.898650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f7b66-8277-4244-89a6-66d8e74b16ed None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.898919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f7b66-8277-4244-89a6-66d8e74b16ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.934283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-193f7b66-8277-4244-89a6-66d8e74b16ed None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:42.935032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed773b2d-17d4-45dd-b601-3130cad17a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:42.935326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed773b2d-17d4-45dd-b601-3130cad17a5d None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:42.935495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-193f7b66-8277-4244-89a6-66d8e74b16ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:42.935589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed773b2d-17d4-45dd-b601-3130cad17a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:42.935862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed773b2d-17d4-45dd-b601-3130cad17a5d None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/a7056c200e0a4ed7ae683143340cbd04/roles/4464d6860e5f43449760b1be307f75d8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:42.937932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed773b2d-17d4-45dd-b601-3130cad17a5d None admin] RBAC: Authorizing `identity:create_grant(project_id=cb7426167797495c89da5ca88d7a02f3, user_id=a7056c200e0a4ed7ae683143340cbd04, role_id=4464d6860e5f43449760b1be307f75d8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:42.939403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed773b2d-17d4-45dd-b601-3130cad17a5d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:42.958438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 81/157] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:42 2022] PUT /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3/users/a7056c200e0a4ed7ae683143340cbd04/roles/4464d6860e5f43449760b1be307f75d8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:43.013648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f8df-fdcd-4728-a108-9fb998cdb264 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:43.013964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f8df-fdcd-4728-a108-9fb998cdb264 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:43.014205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f8df-fdcd-4728-a108-9fb998cdb264 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:43.015877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 82/158] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:43.023186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec336ee6-b2b6-49cd-a09d-907a0d7b268e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:43.023483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec336ee6-b2b6-49cd-a09d-907a0d7b268e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:43.023735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec336ee6-b2b6-49cd-a09d-907a0d7b268e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:43.036791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 77/159] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:43.047728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ec336ee6-b2b6-49cd-a09d-907a0d7b268e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:43.048964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ec336ee6-b2b6-49cd-a09d-907a0d7b268e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:43.145408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 83/160] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:43.310574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd044301-1ff4-429f-a0f3-072b48dc6050 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:43.310834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd044301-1ff4-429f-a0f3-072b48dc6050 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:43.311101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd044301-1ff4-429f-a0f3-072b48dc6050 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:43.312523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 78/161] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:43.318054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:43.318539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:43.318632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:43.341028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:43.342480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:43.409308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:43.430073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 84/162] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:43.469295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd044301-1ff4-429f-a0f3-072b48dc6050 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:43.583827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:43.620302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd044301-1ff4-429f-a0f3-072b48dc6050 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:43.668323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:43.668959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:43.669238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:43.669540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:43.686275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:43.691105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:43.693258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:43.695267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 79/163] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:43.699720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:43.760504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:43.903372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ed66-cb71-435c-8157-6bca93a6a3ac None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:43.945416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6a0ba-8b9a-4961-b6a2-787085fb490d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:43.980519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:43.981191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:43.981496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:43.981765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:43.982443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:43.982741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:43.984123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:43.991266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:43.997750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 85/164] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:43.998613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.022073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.022723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.023004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.023274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.070002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:44.074897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:44.076960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 80/165] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:27:44.078928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.088004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:44.161373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c38fe-d3f6-4c3b-951f-5cb10b2ae3da None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:44.219448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.220097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.220376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.220629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.244726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:44.255982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:44.258177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 86/166] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:27:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:44.260149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.262127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96b0a-c0c3-4aeb-b564-34f58e4d9de7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:44.310915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.311549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.311823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.312090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] PATH_INFO: `/v3/users/77a3dd5bae654f599f156f30a08466b7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.315020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] RBAC: Authorizing `identity:get_user(user_id=77a3dd5bae654f599f156f30a08466b7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:44.317124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:44.319009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 81/167] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:44 2022] GET /identity/v3/users/77a3dd5bae654f599f156f30a08466b7 => generated 247 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:44.319693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.430000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:44.434476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036c325-1377-4440-a61d-0a5842a9e8c4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:44.456901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:44.505493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.506113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.506391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.506663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.508302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:44.508607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:44.510041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:44.518415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef6014-bc57-4d05-8002-f72968652827 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:44.533569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 87/168] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:44.534244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.595766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.596378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.596656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.596927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.598445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:44.598752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:44.600123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:44.621061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 82/169] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:27:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:44.621947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.748951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24ef0-66ae-4e65-ae3d-3121d32ffd65 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:44.775362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa395f-ab80-4a97-9a03-94b0e21ac786 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:44.782069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:44.807528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.808171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.808449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.808718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.810549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:44.812101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:44.813915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 83/170] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:44 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:44.815089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:44.862610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:44.863850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:44.864136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:44.864408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:44.967907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:44.997531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61048bc-0c01-4645-b9ae-f61f0ec92dff None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.038576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.039989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.060248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:45.060943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.061230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.061526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] PATH_INFO: `/v3/users/b89b287edf244e8abe3dd68d5134f421` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.065548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] RBAC: Authorizing `identity:get_user(user_id=b89b287edf244e8abe3dd68d5134f421)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.067358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.069172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 84/171] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:44 2022] GET /identity/v3/users/b89b287edf244e8abe3dd68d5134f421 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:45.069785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:45.156563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:45.205728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 88/172] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:45.205728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:45.245052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2a83e-b66f-4b0c-ad91-3911a9f5dca4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.274390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:45.309741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724de19-8912-4131-9358-1d70957eb0e9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.319014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:45.319661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.319937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.320203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.349118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf82b7-a81f-454a-8325-a4642369dd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:45.350126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf82b7-a81f-454a-8325-a4642369dd54 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.350629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf82b7-a81f-454a-8325-a4642369dd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.351093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf82b7-a81f-454a-8325-a4642369dd54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.424598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf82b7-a81f-454a-8325-a4642369dd54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.426496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf82b7-a81f-454a-8325-a4642369dd54 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.439500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.440949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.500962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:45.536869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 89/173] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:45.538510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29737bfe-c828-4a0f-aecf-9df8ea6266c5 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.539078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29737bfe-c828-4a0f-aecf-9df8ea6266c5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.539573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29737bfe-c828-4a0f-aecf-9df8ea6266c5 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.541111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 90/174] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:45.542046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29737bfe-c828-4a0f-aecf-9df8ea6266c5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:45.574020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:45.639445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 85/175] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:45.640346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:45.659452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29737bfe-c828-4a0f-aecf-9df8ea6266c5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.698159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e719c-3f2b-4860-8eb3-878b18db417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:45.698799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e719c-3f2b-4860-8eb3-878b18db417f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.699123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e719c-3f2b-4860-8eb3-878b18db417f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.699396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e719c-3f2b-4860-8eb3-878b18db417f None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.700581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e719c-3f2b-4860-8eb3-878b18db417f None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.702079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e719c-3f2b-4860-8eb3-878b18db417f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.703919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 91/176] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:45.704873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.705152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.705477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.725037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:45.726335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:45.750898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad784d-261a-47e6-8b89-43c6ff4c31c3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.764201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:45.787646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:45.788281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.788562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.788841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.790003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.791511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.793155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 86/177] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:45.793994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:45.801652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 92/178] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:45.802603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:45.825821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:45.910272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166d4b-9315-4d9f-ad7c-9fd2a6548c94 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.930707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694064f-93bd-459f-ab7e-61b595698d0a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:45.947768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:45.948376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.948652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.948921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.949677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=77a3dd5bae654f599f156f30a08466b7) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:45.949985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:45.951495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752654b-7a8f-43fd-a7fc-04bed091ac91 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:45.958257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 93/179] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/role_assignments?user.id=77a3dd5bae654f599f156f30a08466b7&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:45.959226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531e870-8672-459c-8e1c-cd5f592c0119 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:45.959506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531e870-8672-459c-8e1c-cd5f592c0119 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:45.959833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531e870-8672-459c-8e1c-cd5f592c0119 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:45.961035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 94/180] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:45.961760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531e870-8672-459c-8e1c-cd5f592c0119 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.001858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:46.005969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03296c5-59e7-4cbb-9c5d-42b1ad1e7e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:46.006617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03296c5-59e7-4cbb-9c5d-42b1ad1e7e67 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.006893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03296c5-59e7-4cbb-9c5d-42b1ad1e7e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.007163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03296c5-59e7-4cbb-9c5d-42b1ad1e7e67 None admin] PATH_INFO: `/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.014273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03296c5-59e7-4cbb-9c5d-42b1ad1e7e67 None admin] RBAC: Authorizing `identity:get_project(project_id=4b62dc3ebe6f44778e327b88bcaf135a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:46.015750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03296c5-59e7-4cbb-9c5d-42b1ad1e7e67 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:46.017809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 87/181] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/projects/4b62dc3ebe6f44778e327b88bcaf135a => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:46.018810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce6b5-c2d3-431c-884f-baf233b014b1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.019185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce6b5-c2d3-431c-884f-baf233b014b1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.019409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcce6b5-c2d3-431c-884f-baf233b014b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.050449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4bcce6b5-c2d3-431c-884f-baf233b014b1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:46.052189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4bcce6b5-c2d3-431c-884f-baf233b014b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:46.082011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531e870-8672-459c-8e1c-cd5f592c0119 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:46.122079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:46.122694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.122972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.123242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.123973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] RBAC: Adding query filter params (role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=b89b287edf244e8abe3dd68d5134f421) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:46.124346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:46.125847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:46.132910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 95/182] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:45 2022] GET /identity/v3/role_assignments?user.id=b89b287edf244e8abe3dd68d5134f421&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:46.133543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.258978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 88/183] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:46.260092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93800b9-3c44-46b6-b0fa-515cf3c6c60f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.260380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93800b9-3c44-46b6-b0fa-515cf3c6c60f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.260659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93800b9-3c44-46b6-b0fa-515cf3c6c60f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.261947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 89/184] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:46.264033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:46.268189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.268476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.268734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08666b4-1576-46aa-ae49-26ea2f647e88 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:46.268837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.317467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:46.318107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.318389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.318660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.319412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=4b62dc3ebe6f44778e327b88bcaf135a, user.id=b89b287edf244e8abe3dd68d5134f421) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:46.319717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:46.321275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665d59c-b745-43ea-a671-2fd7fa13079c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:46.322521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:46.323771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:46.328903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 96/185] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:46 2022] GET /identity/v3/role_assignments?user.id=b89b287edf244e8abe3dd68d5134f421&scope.project.id=4b62dc3ebe6f44778e327b88bcaf135a&role.id=d0ec590bde8e414995f352abf7f10ace => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:46.331669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9c3cc-dfeb-43aa-a9b2-b70887904b1b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.331669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9c3cc-dfeb-43aa-a9b2-b70887904b1b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.331669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9c3cc-dfeb-43aa-a9b2-b70887904b1b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.333381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 97/186] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:46.340560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.341175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.341734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.370711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:46.372377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:46.375184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:46.476776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 90/187] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 29 23:27:46.478158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.508895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 98/188] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:46.601405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8c595-bbf6-4ab8-bf20-0955307d96e8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:46.618591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.647283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:46.647984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.648268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.648545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.668095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:46.676757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:46.677995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:46.679203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 91/189] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:46.681863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.704070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:46.753920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:46.771519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e912df-eba5-423a-9b22-47a444a7759b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:46.813746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ece5c0-db85-453d-966f-c4d1a07f60b7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:46.826633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:46.827277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.827557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.827827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.843571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:46.850670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:46.851732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:46.852555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 99/190] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:27:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:46.857372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.866690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:46.867318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:46.867599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:46.867868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:46.868549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:46.868912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:46.870348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:46.879773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 92/191] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:46.880851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:46.956006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:46.968877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8e47-3c55-4da1-97c1-c11357b825f6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:46.981729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2d84-ae3a-4f0b-9e97-67bb7e5af924 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.002831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.003459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.004268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.004546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.005680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.007128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.008684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 100/192] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:47.009465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.016373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.016981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.017254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.017548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.018212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:47.018509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.020730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.029241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 93/193] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:27:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:47.030279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.038863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.126405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f5fe-028b-45ec-ba1f-8417ccfbc492 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.132518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d249-df0c-44b4-a50e-aabf5652da72 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.166425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.167048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.167323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.167588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.169605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.170403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.170678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.170945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] PATH_INFO: `/v3/users/6ad45f72a6b7463893dc9a23eb66b363` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.175806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.177953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:47.183359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:47.184239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:47.185030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 101/194] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:47.186614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.188153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad45f72a6b7463893dc9a23eb66b363)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.189752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.196908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 94/195] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/users/6ad45f72a6b7463893dc9a23eb66b363 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:47.196908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.278116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.297726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36644af9-e12f-4812-9ccd-b9d1def8c881 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.304234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7985002-128d-48d9-a496-3ff3d83c67c6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.332867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.333739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.333946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.334219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.334874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.336327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.339434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.340055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.340334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.340600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] PATH_INFO: `/v3/users/6ad45f72a6b7463893dc9a23eb66b363` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.341739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad45f72a6b7463893dc9a23eb66b363)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.343162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.344894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 95/196] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/users/6ad45f72a6b7463893dc9a23eb66b363 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:47.345502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.362683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 102/197] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:47 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:47.364090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.418130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.467515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9bb08-6e31-4182-a255-0bf72a4203d2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.495978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab79c8-111b-47ed-9fc8-eaa5b3784ab0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.506903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.507518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.507797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.508069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.508792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:47.509043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.510491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.523242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 96/198] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:47.524347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.544033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.545025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.545025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.545173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.550188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.641079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.642629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.657657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b170493-4905-4a79-a85b-934f55a99764 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.690113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.704132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.704754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.705247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.705468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.774585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 103/199] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:47.775763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.788536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.790390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.812940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.884155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abf534-39b1-49be-b928-964af3629ff3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:47.896527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 97/200] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:47.897800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:47.924437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:47.924866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:47.925080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:47.926148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:47.926507 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] PATH_INFO: `/v3/users/a7056c200e0a4ed7ae683143340cbd04` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:47.928108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] RBAC: Authorizing `identity:get_user(user_id=a7056c200e0a4ed7ae683143340cbd04)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:47.929785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:47.931463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 104/201] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/users/a7056c200e0a4ed7ae683143340cbd04 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:47.932272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:48.013133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff3ac5-9429-45df-b893-362f8f4cb1c5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.054479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.055283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.055477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.055721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.056919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.058658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.060630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 98/202] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:48.061363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:48.068644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b24c12-c70d-4c55-9ba5-d560095dbb2d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.071328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:48.116568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.117297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.117603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.117869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.119100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.120547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.128023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 105/203] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:47 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:48.128959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:48.189717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:48.201692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf31780-4b67-4303-84af-66722c44807c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.242097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.242739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed79a0-23e8-4e20-8379-08a0a5265257 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.243167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.243601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.244016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.282680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.283713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.284320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.284755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.286282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=6ad45f72a6b7463893dc9a23eb66b363) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:48.286714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.288486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.294698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 106/204] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:48 2022] GET /identity/v3/role_assignments?user.id=6ad45f72a6b7463893dc9a23eb66b363&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:48.295965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:48.330875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.333383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.338621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:48.431721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba241cd-6eba-462e-a198-3a9d3aab1ab3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.447091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:48.460706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 99/205] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:48.466814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:48.470885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.471556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.471899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.472234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.473243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] RBAC: Adding query filter params (role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=6ad45f72a6b7463893dc9a23eb66b363) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:48.473646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.475188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.481274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 107/206] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:48 2022] GET /identity/v3/role_assignments?user.id=6ad45f72a6b7463893dc9a23eb66b363&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:48.588859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd698b2e-3fac-4451-a37b-621c609eea5f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.631677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b2a5-7871-4161-994c-6de066cd45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.632687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b2a5-7871-4161-994c-6de066cd45f5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.633177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b2a5-7871-4161-994c-6de066cd45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.633700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b2a5-7871-4161-994c-6de066cd45f5 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.635154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b2a5-7871-4161-994c-6de066cd45f5 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.636846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b2a5-7871-4161-994c-6de066cd45f5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.639207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 100/207] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:48 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:48.646203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:48.760424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:48.763696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962d5f-cc9a-43c5-90f9-bc49e0813ddb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:48.803470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:48.804095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:48.804369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:48.804638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:48.805439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] RBAC: Adding query filter params (role.id=4464d6860e5f43449760b1be307f75d8, scope.project.id=cb7426167797495c89da5ca88d7a02f3, user.id=a7056c200e0a4ed7ae683143340cbd04) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:48.805824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:48.807345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13a1bd-f42d-4c33-ab7e-b42ee660b7fd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:48.814873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 108/208] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:48 2022] GET /identity/v3/role_assignments?user.id=a7056c200e0a4ed7ae683143340cbd04&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=4464d6860e5f43449760b1be307f75d8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:49.723369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a7061-9912-44d8-8d0c-c1062133bccc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:49.723949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a7061-9912-44d8-8d0c-c1062133bccc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:49.723949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a7061-9912-44d8-8d0c-c1062133bccc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:49.725284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 101/209] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:49.730771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:49.731205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:49.731357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:49.750126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:49.751319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:49.785663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322776-9793-4c30-aa83-f92e695f4fb6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:49.786003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322776-9793-4c30-aa83-f92e695f4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:49.786316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322776-9793-4c30-aa83-f92e695f4fb6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:49.788243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 102/210] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:49.793914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39812-0f40-443c-8056-86c846002775 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:49.794436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39812-0f40-443c-8056-86c846002775 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:49.794714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c39812-0f40-443c-8056-86c846002775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:49.815280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-64c39812-0f40-443c-8056-86c846002775 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:49.816519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-64c39812-0f40-443c-8056-86c846002775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:49.831568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 109/211] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:49.882900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:49.896945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 103/212] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:50.109318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.166275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39812-0f40-443c-8056-86c846002775 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.217841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:50.226574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345179e-b497-4c7c-aa75-efcd5acf139a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.276061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.276701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.276979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.277250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.279607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:50.281075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:50.283048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 110/213] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:50.288097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.291754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c39812-0f40-443c-8056-86c846002775 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.334004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.335701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.336103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.336476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.351392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:50.358001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:50.358886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:50.360329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 104/214] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:50.366301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.410101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff0b970-6358-4748-b66e-72d8d7e19500 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.436052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:50.448208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.448816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.449145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.449471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.450287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:50.451857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:50.480057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 111/215] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:50 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:27:50.509698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e16c-61cd-4186-809f-dd8a0318b8cd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.553816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.554893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.555411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.555938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.556832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:50.557334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:50.559081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b34fc62-3fab-41f3-bb96-17c26d56b65d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:50.570101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 105/216] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:50.578811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.604195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:50.619849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54585-a9e0-4356-a2a7-8e91d9114fae None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.619849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54585-a9e0-4356-a2a7-8e91d9114fae None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.620255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af54585-a9e0-4356-a2a7-8e91d9114fae None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.621939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 106/217] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:50.628998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84854-b221-46b7-b81c-074088f60056 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.629313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84854-b221-46b7-b81c-074088f60056 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.629617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb84854-b221-46b7-b81c-074088f60056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.650981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0eb84854-b221-46b7-b81c-074088f60056 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:50.652486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0eb84854-b221-46b7-b81c-074088f60056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:50.705556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f48067-f9a0-4026-aa52-8540aa674776 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.730158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 107/218] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:50.732034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10fc14-389e-4dac-8efa-666853dc1e2a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.732318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10fc14-389e-4dac-8efa-666853dc1e2a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.732591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10fc14-389e-4dac-8efa-666853dc1e2a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.737815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 108/219] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:50.741530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.741890 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.742282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.757981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.758606 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.758881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.759148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] PATH_INFO: `/v3/users/ab7a05573f66403b83defaa8dcada377` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:50.765257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:50.766493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:50.777624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] RBAC: Authorizing `identity:get_user(user_id=ab7a05573f66403b83defaa8dcada377)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:50.779818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:50.782016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 112/220] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:50 2022] GET /identity/v3/users/ab7a05573f66403b83defaa8dcada377 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:50.790360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:50.813536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:50.866706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 109/221] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:50.887416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:50.914308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3feccaa-839c-47d4-9e98-94153fb3135c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:50.953936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:50.954548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:50.954828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:50.955098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.029012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.030651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.035533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.158301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:51.210464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 113/222] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:27:51.218107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.247109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322b0e-2e6d-4485-9a27-5b662fb71b55 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.284232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.284668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.285593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.285861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.298301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:51.304930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:51.305980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:51.306767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:51.312095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 110/223] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:27:51.313070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.344228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07107235-4a5c-4fb1-8820-567ce6f3f598 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.346817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:51.385108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.386141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.386615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.387075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.388620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.390332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.392267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 114/224] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:51.393230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.424845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5c4bf-1a78-4e1c-b9a4-6cd66d60d782 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.457692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:51.464828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.465503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.465779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.466045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.477724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:51.483141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:51.484192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 111/225] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:51.485191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.523163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a381e7-f846-4e52-9e06-71df8984bd08 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.574693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.575830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.576114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.576385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.577098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:51.577906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.579756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.592390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 115/226] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:51.593066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.599471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:51.610023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782aed4e-9cd9-40a2-8983-1d22bcd44f80 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.648324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.648989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.649269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.649578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.650390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=ab7a05573f66403b83defaa8dcada377) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:51.650693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.652306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.659792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 112/227] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/role_assignments?user.id=ab7a05573f66403b83defaa8dcada377&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=d0ec590bde8e414995f352abf7f10ace => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:51.666585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.739153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8087c56-a5b8-4d68-b16f-6ac2f9c55295 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.748360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:51.787186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.789481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.792425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.792966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.793910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:51.794379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.797433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.819566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 116/228] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:51.825517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.894515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060b4c6-e7d8-4bf9-a86d-7354fa9961f6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:51.943166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:51.943800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:51.944073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:51.944342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] PATH_INFO: `/v3/users/6ad45f72a6b7463893dc9a23eb66b363` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:51.946705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad45f72a6b7463893dc9a23eb66b363)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:51.948146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:51.949746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 113/229] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/users/6ad45f72a6b7463893dc9a23eb66b363 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:51.955237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:51.996287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:52.058270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c60890-1bc4-4241-b84e-9bee8cc4f15d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:52.127076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:52.127759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.128099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.128365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] PATH_INFO: `/v3/users/6ad45f72a6b7463893dc9a23eb66b363` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.130729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] RBAC: Authorizing `identity:get_user(user_id=6ad45f72a6b7463893dc9a23eb66b363)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:52.133201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:52.134917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 117/230] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/users/6ad45f72a6b7463893dc9a23eb66b363 => generated 283 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:52.152035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:52.157688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b534e1b-18a3-410a-91c9-d48acb58dfa3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:52.218778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:52.221719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:52.222904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.223190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.223460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.224573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:52.226045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:52.228553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 114/231] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:51 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:52.234643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:52.333078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723d49d-92c1-4a72-8767-1302ed3fef05 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:52.357902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:52.371819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:52.372713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.373199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.373645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.375111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:52.376755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:52.377990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5f9e7-2959-40f6-9c7b-e7057719e1f4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:52.378852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 118/232] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:52 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:52.384672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:52.449908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a592fe-9ef8-43c7-8c38-30bc485d2198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:52.450579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a592fe-9ef8-43c7-8c38-30bc485d2198 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.450859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a592fe-9ef8-43c7-8c38-30bc485d2198 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.451126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a592fe-9ef8-43c7-8c38-30bc485d2198 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/6ad45f72a6b7463893dc9a23eb66b363/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.455688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a592fe-9ef8-43c7-8c38-30bc485d2198 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb145507b2455090e4df43802bd1bb, user_id=6ad45f72a6b7463893dc9a23eb66b363, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:52.457717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a592fe-9ef8-43c7-8c38-30bc485d2198 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:52.483929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 115/233] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:52 2022] PUT /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/6ad45f72a6b7463893dc9a23eb66b363/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:52.514511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d67e1-1b9a-4bab-a605-b5ba007beb0c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:52.538840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:52.554429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9e8e4-8d2f-40e1-9188-3d73402a0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:52.555180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9e8e4-8d2f-40e1-9188-3d73402a0ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.555527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9e8e4-8d2f-40e1-9188-3d73402a0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.555867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9e8e4-8d2f-40e1-9188-3d73402a0ae8 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/6ad45f72a6b7463893dc9a23eb66b363/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.558250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9e8e4-8d2f-40e1-9188-3d73402a0ae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb145507b2455090e4df43802bd1bb, user_id=6ad45f72a6b7463893dc9a23eb66b363, role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:52.559835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9e8e4-8d2f-40e1-9188-3d73402a0ae8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:52.576271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 119/234] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:52 2022] PUT /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/6ad45f72a6b7463893dc9a23eb66b363/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:52.752858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a9117-8ae4-48ff-a6b7-eb418fcf36dd None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.753235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a9117-8ae4-48ff-a6b7-eb418fcf36dd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.753518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228a9117-8ae4-48ff-a6b7-eb418fcf36dd None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.755067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 116/235] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:52.761273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618492-cd3f-485c-a628-49b146520f75 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:52.761596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618492-cd3f-485c-a628-49b146520f75 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:52.761881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55618492-cd3f-485c-a628-49b146520f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:52.783665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-55618492-cd3f-485c-a628-49b146520f75 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:52.785532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-55618492-cd3f-485c-a628-49b146520f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:52.862766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 120/236] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:53.210315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632d340-0ef7-4f2c-9a0b-ba7b5f12a997 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:53.210821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632d340-0ef7-4f2c-9a0b-ba7b5f12a997 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:53.211240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632d340-0ef7-4f2c-9a0b-ba7b5f12a997 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:53.213897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 117/237] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:53.222092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:53.222607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:53.223072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:53.259925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:53.261125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:53.263038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632d340-0ef7-4f2c-9a0b-ba7b5f12a997 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:53.403097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 121/238] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:53.520189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632d340-0ef7-4f2c-9a0b-ba7b5f12a997 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:53.609262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:53.610817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:53.611600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:53.612339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:53.634678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:53.645520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:53.647155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:53.648734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:53.660458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 118/239] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:53.669897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:53.717010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:53.826137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d918d-ef63-4268-baa5-a40c20419dfc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:53.882096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:53.883080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:53.883080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:53.883314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:53.883924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:53.884229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:53.885671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:53.895305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 122/240] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:53.904338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:53.952362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:53.998823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:54.131448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f09ab-7d49-4835-a483-e2862737a239 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:54.156350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:54.183906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc586e-aa67-4fd0-9072-b5c1d509eb7f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:54.196449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:54.197081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.197374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.197665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] PATH_INFO: `/v3/users/4722ed3970a342f89b5340ddbbeda848` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.223841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=4722ed3970a342f89b5340ddbbeda848)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:54.225233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:54.226955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 119/241] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:53 2022] GET /identity/v3/users/4722ed3970a342f89b5340ddbbeda848 => generated 297 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:54.233669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:54.255684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:54.256371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.256768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.257042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.258214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:54.259869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:54.261833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 123/242] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:54.270228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:54.361626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:54.395623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea380a-a156-4959-be68-d3eac78bd1e5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:54.425022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41112e-5b1d-4637-b43c-670bccf3fc80 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:54.436378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0a918-83e9-4b4d-88de-02f88bc1378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:54.437725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0a918-83e9-4b4d-88de-02f88bc1378f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.438281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0a918-83e9-4b4d-88de-02f88bc1378f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.438716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0a918-83e9-4b4d-88de-02f88bc1378f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.468734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bbf71-d91a-4bbe-88ba-bad147215760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:54.470194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bbf71-d91a-4bbe-88ba-bad147215760 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.470654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bbf71-d91a-4bbe-88ba-bad147215760 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.471356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bbf71-d91a-4bbe-88ba-bad147215760 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.472505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bbf71-d91a-4bbe-88ba-bad147215760 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:54.474947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bbf71-d91a-4bbe-88ba-bad147215760 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:54.510239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 124/243] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:54 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:54.513064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4665146-ef94-4d3d-84ad-23e4c462c005 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.514536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4665146-ef94-4d3d-84ad-23e4c462c005 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.514863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4665146-ef94-4d3d-84ad-23e4c462c005 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.517335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 125/244] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:54.525438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.525741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.525981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.553051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0a918-83e9-4b4d-88de-02f88bc1378f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:54.554578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0a918-83e9-4b4d-88de-02f88bc1378f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:54.563537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:54.564753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:54.582316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:54.684987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 126/245] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:54.694943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:54.734848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 120/246] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:27:54.736253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:54.830926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ef32-a01c-4d44-808c-c0b7bd32b11a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.831215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ef32-a01c-4d44-808c-c0b7bd32b11a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.831523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524ef32-a01c-4d44-808c-c0b7bd32b11a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.833046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 121/247] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:54.840465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.841512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.841994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.867329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:54.868523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:54.876118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183cc12-57f1-4d60-bc02-6e46f7bfc1f0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:54.915242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:54.916655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:54.917129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:54.917682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:54.919922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:54.921625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:54.923787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 127/248] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:54 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:54.930508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:54.943758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:54.966124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 122/249] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:55.002147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.057873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad9dca-b384-4c15-8311-c7da70ec5543 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.101609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.102470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.102920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.103333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.104244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] RBAC: Adding query filter params (role.id=4464d6860e5f43449760b1be307f75d8, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=4722ed3970a342f89b5340ddbbeda848) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:55.104707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.106337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.113856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 128/250] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:54 2022] GET /identity/v3/role_assignments?user.id=4722ed3970a342f89b5340ddbbeda848&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=4464d6860e5f43449760b1be307f75d8 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:55.138136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:55.152710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052d20f-8b81-40a0-9a1f-66c1348574b1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.194529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfba4eb-568e-4275-9322-8ba42436ce1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.195208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba4eb-568e-4275-9322-8ba42436ce1e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.195578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba4eb-568e-4275-9322-8ba42436ce1e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.195850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfba4eb-568e-4275-9322-8ba42436ce1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.208375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfba4eb-568e-4275-9322-8ba42436ce1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fbfba4eb-568e-4275-9322-8ba42436ce1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:55.213665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:55.214585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:55.215536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 123/251] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:55.222967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.253441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe0ee-e931-4288-a36e-a6ea71568825 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.254285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe0ee-e931-4288-a36e-a6ea71568825 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.254809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cfe0ee-e931-4288-a36e-a6ea71568825 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 124/252] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:27:55.262658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.263173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.263614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.285838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:55.287283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:55.334238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:55.375840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 125/253] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:55.376127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc48ad-7b1e-4242-8ac8-aa2ec9205bd1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.377111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.429406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.430390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.430815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.431254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.432066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:55.432607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.434406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.448542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 129/254] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:55.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.525652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:55.544185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38756c0-20a5-454a-8128-351d0ff4b0d3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.564562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b556b07-7a8b-42d1-ac1a-13399d7030fa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.591131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.591971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.592091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.592308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.604363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.605043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:55.605660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.606143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.606612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] PATH_INFO: `/v3/users/ab7a05573f66403b83defaa8dcada377` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.607964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] RBAC: Authorizing `identity:get_user(user_id=ab7a05573f66403b83defaa8dcada377)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.609676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:55.610039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:55.610885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:55.612265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 126/255] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:55.617474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 130/256] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/users/ab7a05573f66403b83defaa8dcada377 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:55.617602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.621636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.625252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:55.754955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e6db-cc84-40ab-a5ca-29bb9b19b93e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.771417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da799cf-66bb-4799-a708-c15558bce9b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.799141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.801041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.802368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.803021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.805942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.808399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.810511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 131/257] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:55.824119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.862710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.863345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.863620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.863884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.864558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:55.864856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.866405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:55.884930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 127/258] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:55.890498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:55.906344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:55.923999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:55.942938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f617654-9d56-4b86-aa22-d6c6a89797f1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:55.979570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:55.980625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:55.981170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:55.981696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/ab7a05573f66403b83defaa8dcada377/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:55.983851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb145507b2455090e4df43802bd1bb, user_id=ab7a05573f66403b83defaa8dcada377, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:55.985567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:56.001433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 132/259] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:55 2022] PUT /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/ab7a05573f66403b83defaa8dcada377/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:27:56.002643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:56.128222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cbeb0-931b-4805-bbf0-3789460a75c6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.161832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:56.167485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.168475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.168965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.169574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:56.186676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:56.199725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:56.200811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:27:56.201634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:56.204171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 133/260] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:27:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:56.211317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:56.219018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf431e0-4fa4-4416-9d31-810661b78805 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.306086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.306743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.307001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.307276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] PATH_INFO: `/v3/users/6ad45f72a6b7463893dc9a23eb66b363` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:56.308472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] RBAC: Authorizing `identity:get_user(user_id=6ad45f72a6b7463893dc9a23eb66b363)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:56.309964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:56.311839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 128/261] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:55 2022] GET /identity/v3/users/6ad45f72a6b7463893dc9a23eb66b363 => generated 283 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:56.317962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:56.327884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c547f-888b-4d48-9a7a-9da33ce986f6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.365557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.366754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.367257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.367770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:56.368645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:56.369681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:56.371974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:56.383168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 134/262] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:27:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:56.388137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:56.449731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:56.499835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adac006-15bf-4d00-afcd-7a8678f58484 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.557446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.558591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.559074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.559544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] PATH_INFO: `/v3/users/6ad45f72a6b7463893dc9a23eb66b363` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:56.562719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] RBAC: Authorizing `identity:get_user(user_id=6ad45f72a6b7463893dc9a23eb66b363)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:56.564866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:56.568399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 135/263] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:56 2022] GET /identity/v3/users/6ad45f72a6b7463893dc9a23eb66b363 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:56.573877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:56.625712 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:56.642818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da455fa-675b-428a-947c-88e074503e7a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.715041 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.715663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.715943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.716213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:56.809290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab4dbd0-7100-47aa-ab94-1c971f1b7b0c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:56.853696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:56.864158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:56.865678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:56.886263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:56.886893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:56.887174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:56.887453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.020336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:57.023418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:57.033749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:57.070547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 129/264] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:27:57.079079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:57.224006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 136/265] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:27:57.229572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:57.261731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:57.348690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313b291-96d4-4fe6-984b-900db0652f63 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:57.355051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2cb7cc-2dea-40a0-ac01-3935417134fc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:57.422068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:57.422854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.423129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.423703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.426466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:57.427936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:57.428731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:57.429465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.429570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 137/266] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:57 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:57.429958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.430221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.431567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:57.433066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:57.435250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 130/267] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:57 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:57.435528 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:57.441907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:57.522979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:57.597918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:57.616550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025b8db-2155-4689-b26e-71c0b06173f8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:57.653970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c08fda-99ab-4a5f-8492-86fe1b50659d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:57.691384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:57.692467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.692943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.693382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.694260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=6ad45f72a6b7463893dc9a23eb66b363) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:57.694709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:57.696430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349cb33-34c8-46bc-bda2-55efae5ad7b1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:57.703953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 131/268] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:57 2022] GET /identity/v3/role_assignments?user.id=6ad45f72a6b7463893dc9a23eb66b363&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:57.710586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:57.711068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b41b5-bb8a-4f79-bbce-910e8d321a45 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.711240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.711502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.711766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.712517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b41b5-bb8a-4f79-bbce-910e8d321a45 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.712757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] RBAC: Adding query filter params (role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=6ad45f72a6b7463893dc9a23eb66b363) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:57.713059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:57.713410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b41b5-bb8a-4f79-bbce-910e8d321a45 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.714546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6095f-4e8b-4bd3-9033-9781a6e09a22 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:57.715574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 132/269] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:57.728867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02dca-52f0-40a1-a631-910ff8da1551 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.729527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02dca-52f0-40a1-a631-910ff8da1551 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.730020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b02dca-52f0-40a1-a631-910ff8da1551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.736326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 138/270] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:27:57 2022] GET /identity/v3/role_assignments?user.id=6ad45f72a6b7463893dc9a23eb66b363&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:57.766657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-12b02dca-52f0-40a1-a631-910ff8da1551 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:57.768504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12b02dca-52f0-40a1-a631-910ff8da1551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:57.846603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 133/271] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:57.933375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d0a8-9675-45cf-84a4-92af2c870c92 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.933693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d0a8-9675-45cf-84a4-92af2c870c92 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.933877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53d0a8-9675-45cf-84a4-92af2c870c92 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.935443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 139/272] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:57.941451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:57.942092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:57.942573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:57.970525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:57.972659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:58.026101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:58.050566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930cc9-3b1f-41fe-a346-6ac2ac64844b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.051118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930cc9-3b1f-41fe-a346-6ac2ac64844b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.051118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930cc9-3b1f-41fe-a346-6ac2ac64844b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.052692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 140/273] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:58.063802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.063802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.063802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.070113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 134/274] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:27:58.087733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:58.088928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:58.181687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 141/275] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:58.225988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.366811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68fb96-41a5-45de-b722-82a3bb06c29c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.405075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.423024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:58.423661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.423935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.424196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.439651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:58.445324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:58.446220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:58.447076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:58.452885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 135/276] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:58.453833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.490906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:58.515737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:58.541846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded1a82-7aca-49fc-b3cb-3ed4667a331b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.572475 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c2dfc-711d-4a6c-9488-f7d0942609bc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.577835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:58.578465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.578738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.579004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.580122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:58.581745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:58.584199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 142/277] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:58.589720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.610074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:58.610693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.610969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.611237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.611918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:58.612214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:58.614163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:58.622985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 136/278] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:58.623782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.704602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9cda-83f1-454c-9b37-cfb53c99b78c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.726172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:58.735307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff24be-d468-4b72-94e6-3d4f24fb3307 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.742286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:58.742838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.743115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.743378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.754793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:58.760470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:58.761662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:27:58.762469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 143/279] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:58.763107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.777831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:58.780259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:58.781004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.781312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.781942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.782366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:58.783766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:58.816807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 137/280] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:27:58 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:27:58.818195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:58.913212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e5f1-0f85-413b-9738-ee1f12d2f41a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.958291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13c12b-2bb4-4bec-b996-1916089dc73b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:58.968546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:58.969185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:58.969488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:58.969758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] PATH_INFO: `/v3/users/470c7ddf5a6343d796d854be684cf877` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:58.987956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] RBAC: Authorizing `identity:get_user(user_id=470c7ddf5a6343d796d854be684cf877)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:58.990077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:58.991341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 144/281] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/users/470c7ddf5a6343d796d854be684cf877 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:58.997089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:59.006098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:59.007101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.007582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.008050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.008916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:59.009478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:59.011077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:59.020905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 138/282] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:59.026859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:59.045107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:59.076138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:59.119570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf2cf5-05b5-4dc0-90ae-6ff827c8f74c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:59.159998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b045b-1a33-4dca-9ab5-0fd3065fd36c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:59.172267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:59.172875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.173156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.173498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.174336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, user.id=470c7ddf5a6343d796d854be684cf877, scope.system=all) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:27:59.174789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:59.176283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729bea0-948c-4351-990f-88351f90e482 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:59.182950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 145/283] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Aug 29 23:27:58 2022] GET /identity/v3/role_assignments?user.id=470c7ddf5a6343d796d854be684cf877&scope.system=all&role.id=d0ec590bde8e414995f352abf7f10ace => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:27:59.184271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9429-98d8-47a0-9734-225bdb438399 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.184561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9429-98d8-47a0-9734-225bdb438399 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.184836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd9429-98d8-47a0-9734-225bdb438399 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.186580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 146/284] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:27:59.192946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.193372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.193655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.201926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:59.202928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.203410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.203875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] PATH_INFO: `/v3/users/4722ed3970a342f89b5340ddbbeda848` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.205255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] RBAC: Authorizing `identity:get_user(user_id=4722ed3970a342f89b5340ddbbeda848)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:59.207513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:59.209336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 139/285] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:27:59 2022] GET /identity/v3/users/4722ed3970a342f89b5340ddbbeda848 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:59.214222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:27:59.215508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:27:59.216301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:59.337615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 147/286] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:27:59.351178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:59.387279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756dfad-27b8-4a95-94dd-463049126b71 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:59.442094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:59.442745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.443025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.443293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.444477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:59.446176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:59.447928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 140/287] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:27:59 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:27:59.454185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:59.547229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:27:59.599871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c924333-8c7a-4938-96ed-68476d45f4a7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:59.647168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:59.647826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.648101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.648369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/4722ed3970a342f89b5340ddbbeda848/roles/4464d6860e5f43449760b1be307f75d8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.650271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb145507b2455090e4df43802bd1bb, user_id=4722ed3970a342f89b5340ddbbeda848, role_id=4464d6860e5f43449760b1be307f75d8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:27:59.651783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:27:59.673501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 148/288] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:27:59 2022] PUT /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb/users/4722ed3970a342f89b5340ddbbeda848/roles/4464d6860e5f43449760b1be307f75d8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:27:59.718151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:27:59.880755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bc028-a19b-4263-80eb-50b85c518182 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:27:59.916772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:27:59.917423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:27:59.917702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:27:59.917974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:27:59.929383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:27:59.935403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:27:59.936286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:27:59.937737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 141/289] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:27:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:27:59.942925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:00.080332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3710d3-5e5d-46ca-b068-a43e328fd612 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:00.122735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:00.134451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:00.135405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:00.135888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:00.136373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:00.137240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:00.137761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:00.139381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:00.157384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 149/290] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:00.162234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:00.180561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:00.290861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe50db-650b-4f7c-b1ff-20a7836fb2e0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:00.346059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:00.347652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:00.348159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:00.348633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] PATH_INFO: `/v3/users/ab7a05573f66403b83defaa8dcada377` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:00.350058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] RBAC: Authorizing `identity:get_user(user_id=ab7a05573f66403b83defaa8dcada377)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:00.351725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:00.353559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 142/291] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:00 2022] GET /identity/v3/users/ab7a05573f66403b83defaa8dcada377 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:00.359484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:00.510543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ef521-f096-4277-ad6d-b377ae1c5f44 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:00.555681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:00.556347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:00.556626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:00.556891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:00.629755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:00.649129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:00.650630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:00.784563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 150/292] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:00.790414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:00.923525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:00.957612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15b9c-5369-4546-86c2-b04e1b8e1bdf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:01.006150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820aed1-0fdc-4dda-a7b2-7c313d140399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:01.006799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820aed1-0fdc-4dda-a7b2-7c313d140399 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.007081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820aed1-0fdc-4dda-a7b2-7c313d140399 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.007355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820aed1-0fdc-4dda-a7b2-7c313d140399 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.010105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820aed1-0fdc-4dda-a7b2-7c313d140399 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:01.011559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820aed1-0fdc-4dda-a7b2-7c313d140399 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:01.013392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 143/293] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:00 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:01.019659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:01.141741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:01.155031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c55073-60fd-4d85-becc-bfc72ad63a32 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:01.190380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:01.191521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.191798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.192064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.192786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=ab7a05573f66403b83defaa8dcada377) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:01.193088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:01.194561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cee3e-3d9d-423f-887c-4ea1ce501e67 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:01.201405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 151/294] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:01 2022] GET /identity/v3/role_assignments?user.id=ab7a05573f66403b83defaa8dcada377&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=d0ec590bde8e414995f352abf7f10ace => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:01.381532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8da9-b2da-49a8-aaeb-ee6a835ff6ad None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.381863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8da9-b2da-49a8-aaeb-ee6a835ff6ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.382090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a8da9-b2da-49a8-aaeb-ee6a835ff6ad None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.383721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 144/295] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:01.389508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e834-c9ab-4e58-a6dc-267ea40e6e65 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.390265 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e834-c9ab-4e58-a6dc-267ea40e6e65 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.390765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e834-c9ab-4e58-a6dc-267ea40e6e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.410504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-65b4e834-c9ab-4e58-a6dc-267ea40e6e65 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:01.412112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-65b4e834-c9ab-4e58-a6dc-267ea40e6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:01.489994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5118-6911-4dc2-9664-66ce816e56da None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.490305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5118-6911-4dc2-9664-66ce816e56da None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.490611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff5118-6911-4dc2-9664-66ce816e56da None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.492146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 145/296] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:01.496873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318290-0cc8-41d5-9090-007655a3a483 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.497151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318290-0cc8-41d5-9090-007655a3a483 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.497451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd318290-0cc8-41d5-9090-007655a3a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.507109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 152/297] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:01.519185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dd318290-0cc8-41d5-9090-007655a3a483 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:01.520370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dd318290-0cc8-41d5-9090-007655a3a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:01.594111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 146/298] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:01.606700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3285c-4f99-4477-acb8-21dadaa9713a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.606990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3285c-4f99-4477-acb8-21dadaa9713a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.607311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3285c-4f99-4477-acb8-21dadaa9713a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.608912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 153/299] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:01.614967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.615253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.615524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.635679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:01.636900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:01.710309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 147/300] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:01.806806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3285c-4f99-4477-acb8-21dadaa9713a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:01.893689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:01.899395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:01.901779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:01.927405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3285c-4f99-4477-acb8-21dadaa9713a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:01.965742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:01.966288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:01.966565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:01.966833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:01.978498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:01.983798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:01.984677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:01.985487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:01.989811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 154/301] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:01.991137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.031946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9b68-c311-4024-9091-662f6088fd3b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.069965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.070834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.071109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.071378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.072889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.074713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.076739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 148/302] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:02.078350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.102668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2652fc-dd9c-4c09-9b4d-210cfec83457 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.137917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.138639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.138921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.139188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.139864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:02.140168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.141605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.147879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:02.151744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 155/303] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:02.155515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.162722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:02.193608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0018bf-2e0d-4deb-a91a-853013bee13c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.228353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2abc40-bf66-4531-9ce5-647b85e32db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.228901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2abc40-bf66-4531-9ce5-647b85e32db4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.229178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2abc40-bf66-4531-9ce5-647b85e32db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.229486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2abc40-bf66-4531-9ce5-647b85e32db4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.240434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2abc40-bf66-4531-9ce5-647b85e32db4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9b2abc40-bf66-4531-9ce5-647b85e32db4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:02.245228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:02.246152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:02.247020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 149/304] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:02.247848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dbcba-5ff3-4181-a46a-8339c98d3f69 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.247848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dbcba-5ff3-4181-a46a-8339c98d3f69 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.248030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dbcba-5ff3-4181-a46a-8339c98d3f69 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.252921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 150/305] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:02.252921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dbcba-5ff3-4181-a46a-8339c98d3f69 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.264496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a9e7b3-f660-4a39-a146-b80d59eb03f9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.297758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.298361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.298643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.298919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] PATH_INFO: `/v3/groups` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.299545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.302071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.320900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 156/306] 10.222.0.67 () {60 vars in 1134 bytes} [Mon Aug 29 23:28:02 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:02.321765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.370808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dbcba-5ff3-4181-a46a-8339c98d3f69 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.389800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:02.414832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:02.420994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f97b8a-6106-4c67-b011-011b05ad60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.421663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f97b8a-6106-4c67-b011-011b05ad60c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.421939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f97b8a-6106-4c67-b011-011b05ad60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.422207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f97b8a-6106-4c67-b011-011b05ad60c5 None admin] PATH_INFO: `/v3/users/3a5e1a8c44d541849cafe03fea5b8473` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.439122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f97b8a-6106-4c67-b011-011b05ad60c5 None admin] RBAC: Authorizing `identity:get_user(user_id=3a5e1a8c44d541849cafe03fea5b8473)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.439458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cef02-2829-42f8-8dcc-78a8f87f7b2b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.440590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f97b8a-6106-4c67-b011-011b05ad60c5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.443235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 151/307] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:02 2022] GET /identity/v3/users/3a5e1a8c44d541849cafe03fea5b8473 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:02.444171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.444451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.444721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.465697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:02.466880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:02.489267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.489892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.490177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.490459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.491128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:02.491726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.493213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.503866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 157/308] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:02.504719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.551355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 152/309] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:02.552053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.627182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf553a6-7cfc-4348-8aa9-5720af2e04ce None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.652243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:02.666911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.667518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.667798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.668071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.668798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] RBAC: Adding query filter params (role.id=4464d6860e5f43449760b1be307f75d8, user.id=3a5e1a8c44d541849cafe03fea5b8473, scope.system=all) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:02.669109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.670599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.676612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 158/310] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Aug 29 23:28:02 2022] GET /identity/v3/role_assignments?user.id=3a5e1a8c44d541849cafe03fea5b8473&scope.system=all&role.id=4464d6860e5f43449760b1be307f75d8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:02.680950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998a707-067d-4092-a8a0-c26c5934caca None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.706339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:02.723390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.724059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.724340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.724612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] PATH_INFO: `/v3/users/470c7ddf5a6343d796d854be684cf877` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.725990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] RBAC: Authorizing `identity:get_user(user_id=470c7ddf5a6343d796d854be684cf877)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.727506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.729394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 153/311] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:02 2022] GET /identity/v3/users/470c7ddf5a6343d796d854be684cf877 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:02.735202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.852298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312743a-fe1c-4fbc-b399-62934017b2d9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:02.861516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:02.894293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:02.895629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:02.896336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:02.896795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] PATH_INFO: `/v3/system/users/470c7ddf5a6343d796d854be684cf877/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:02.899122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=470c7ddf5a6343d796d854be684cf877, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:02.900965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:02.914028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 159/312] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Aug 29 23:28:02 2022] PUT /identity/v3/system/users/470c7ddf5a6343d796d854be684cf877/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:02.990874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f40e0-eaf4-4d72-a1ed-9ec9a45b4b95 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:03.031345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:03.031988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:03.032260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:03.032526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:03.045752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:03.050811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:03.052342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:03.053939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 154/313] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:03.061521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:03.117315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:03.171615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12492a28-8e00-4f51-90ee-1463b69b6f68 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:03.207249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:03.207861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:03.208146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:03.208420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:03.209095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:03.209423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:03.210833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:03.220257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 160/314] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:03.230451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:03.283990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:03.339360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1068739-d258-437d-ba86-91c79c5843f3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:03.376383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:03.376944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:03.377222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:03.377524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] PATH_INFO: `/v3/users/4722ed3970a342f89b5340ddbbeda848` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:03.379199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] RBAC: Authorizing `identity:get_user(user_id=4722ed3970a342f89b5340ddbbeda848)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:03.380641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:03.382619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 155/315] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:03 2022] GET /identity/v3/users/4722ed3970a342f89b5340ddbbeda848 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:03.388386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:03.501464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181e93a-0353-45bd-b4a0-093438f692cc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:03.521719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:03.540046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:03.540667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:03.540948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:03.541269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:03.613116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:03.614693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:03.722973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 161/316] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:03.728256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:03.839173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17849cf7-0c36-443e-8fb5-22a5a459e7d8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:03.857237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:03.876600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f4bc-355d-46ba-8ce0-b3bf48671fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:03.877233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f4bc-355d-46ba-8ce0-b3bf48671fae None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:03.877544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f4bc-355d-46ba-8ce0-b3bf48671fae None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:03.877819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f4bc-355d-46ba-8ce0-b3bf48671fae None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:03.878994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f4bc-355d-46ba-8ce0-b3bf48671fae None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:03.880438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f4bc-355d-46ba-8ce0-b3bf48671fae None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:03.882497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 156/317] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:03 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:03.888468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:03.904165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:03.997222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9630825-4fde-4b27-a19a-b33cb7ca268e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:04.035269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:04.036519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.037115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.037653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.038657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] RBAC: Adding query filter params (role.id=4464d6860e5f43449760b1be307f75d8, scope.project.id=b2cb145507b2455090e4df43802bd1bb, user.id=4722ed3970a342f89b5340ddbbeda848) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:04.039195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:04.040843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fe470f-4aad-4e5d-bee3-e2d96c37c0a9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:04.048377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 162/318] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:03 2022] GET /identity/v3/role_assignments?user.id=4722ed3970a342f89b5340ddbbeda848&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=4464d6860e5f43449760b1be307f75d8 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:04.373397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261034-c826-43d6-908d-eda2c846db8d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.373937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261034-c826-43d6-908d-eda2c846db8d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.373937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad261034-c826-43d6-908d-eda2c846db8d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.375572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 157/319] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:04.381854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823f43-d688-4013-a117-b4d37e653399 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.382344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823f43-d688-4013-a117-b4d37e653399 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.382423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2823f43-d688-4013-a117-b4d37e653399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.401438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f2823f43-d688-4013-a117-b4d37e653399 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:04.402633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f2823f43-d688-4013-a117-b4d37e653399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:04.472541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 163/320] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:04.620775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e563-83e7-472c-ad8c-eb0099e3dd32 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.621111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e563-83e7-472c-ad8c-eb0099e3dd32 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.621446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e563-83e7-472c-ad8c-eb0099e3dd32 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.622814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 158/321] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:04.627894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.628205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.629035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.641156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:04.647711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:04.648939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:04.715372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 164/322] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:04.741007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e563-83e7-472c-ad8c-eb0099e3dd32 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:04.845225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e563-83e7-472c-ad8c-eb0099e3dd32 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:04.886303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd25fd-c1ec-4a76-a2ed-f6416bd3a50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:04.886303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd25fd-c1ec-4a76-a2ed-f6416bd3a50a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.886303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd25fd-c1ec-4a76-a2ed-f6416bd3a50a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.886303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd25fd-c1ec-4a76-a2ed-f6416bd3a50a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.887189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd25fd-c1ec-4a76-a2ed-f6416bd3a50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:04.888392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd25fd-c1ec-4a76-a2ed-f6416bd3a50a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:04.890277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 159/323] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:04.895632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:04.939521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e064b28-d188-4a70-9cb5-01a7718014ed None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.939794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e064b28-d188-4a70-9cb5-01a7718014ed None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.940088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e064b28-d188-4a70-9cb5-01a7718014ed None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.941671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 160/324] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:28:04.946719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:04.947144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:04.947431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:04.965984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:04.967219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:05.002301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364a2ca-1070-4241-920e-d5f58ad8f66c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.015564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:05.036037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.036382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 161/325] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:05.036634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.036909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.037176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] PATH_INFO: `/v3/groups` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.037420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.037838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:05.039282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:05.044996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:05.065405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 165/326] 10.222.0.67 () {60 vars in 1134 bytes} [Mon Aug 29 23:28:04 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:05.162676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e85fe-a861-465c-8c77-ebc38d12ead9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.199432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.200064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.200338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.200603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.214247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:05.218249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:05.219146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:05.220408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 162/327] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:05.225963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.308998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.334997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac9df1-dbda-4e7d-a12a-fd56b1442633 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.369265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:05.375720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.376508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.376774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.377052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.378139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:05.378452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:05.379865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:05.390859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 166/328] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:05.397820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.447264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bdf1f-c193-46ec-a4bd-16742ff66c34 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.484504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:05.503644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.504284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.504564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.504837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.521512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:05.527407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:05.528340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:05.529153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 163/329] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:05.535705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.537906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4feb1-6b2a-456f-a07e-42e627fe2ff1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.578101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.578748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.579023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.579291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] PATH_INFO: `/v3/users/3a5e1a8c44d541849cafe03fea5b8473` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.583490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] RBAC: Authorizing `identity:get_user(user_id=3a5e1a8c44d541849cafe03fea5b8473)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:05.584952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:05.586931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 167/330] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/users/3a5e1a8c44d541849cafe03fea5b8473 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:05.593462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.664838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6251a-07f1-4830-afae-adb817f00223 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.668808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:05.719635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.720580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.721092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.721697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.722704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:05.723212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:05.724821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:05.736708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 164/331] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:05.742496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:05.745183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41ccc4-3d85-43f2-b233-6e744af199ce None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.786151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:05.796539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.797333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.797774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.798151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] PATH_INFO: `/v3/system/users/3a5e1a8c44d541849cafe03fea5b8473/roles/4464d6860e5f43449760b1be307f75d8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.799712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3a5e1a8c44d541849cafe03fea5b8473, role_id=4464d6860e5f43449760b1be307f75d8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:05.802107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:05.811741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 168/332] 10.222.0.67 () {58 vars in 1334 bytes} [Mon Aug 29 23:28:05 2022] PUT /identity/v3/system/users/3a5e1a8c44d541849cafe03fea5b8473/roles/4464d6860e5f43449760b1be307f75d8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:28:05.894622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef96d3f-5e12-429d-a68e-7be68b25b34e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:05.937518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feab8c-46ce-4482-8719-ab94b6755303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:05.938458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feab8c-46ce-4482-8719-ab94b6755303 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:05.938877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feab8c-46ce-4482-8719-ab94b6755303 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:05.939320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feab8c-46ce-4482-8719-ab94b6755303 None admin] PATH_INFO: `/v3/users/470c7ddf5a6343d796d854be684cf877` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:05.941243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feab8c-46ce-4482-8719-ab94b6755303 None admin] RBAC: Authorizing `identity:get_user(user_id=470c7ddf5a6343d796d854be684cf877)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:05.942901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feab8c-46ce-4482-8719-ab94b6755303 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:05.945045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 165/333] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/users/470c7ddf5a6343d796d854be684cf877 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:05.950993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:06.083777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef45da6-61f1-40c8-ac3c-0a4d25a27437 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:06.121114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:06.121766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:06.122049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:06.122322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:06.123055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] RBAC: Adding query filter params (role.id=d0ec590bde8e414995f352abf7f10ace, user.id=470c7ddf5a6343d796d854be684cf877, scope.system=all) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:06.123363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:06.124837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7614a31-1975-4f1c-b3ff-54d43b7aceda None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:06.138994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 169/334] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Aug 29 23:28:05 2022] GET /identity/v3/role_assignments?user.id=470c7ddf5a6343d796d854be684cf877&scope.system=all&role.id=d0ec590bde8e414995f352abf7f10ace => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:07.437194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c637e4-5cf3-48a6-9200-43825d713065 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:07.437730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c637e4-5cf3-48a6-9200-43825d713065 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:07.437730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c637e4-5cf3-48a6-9200-43825d713065 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:07.439414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 166/335] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:07.445791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85d83-d8cc-4b3f-ad89-c86a0db55528 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:07.446277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85d83-d8cc-4b3f-ad89-c86a0db55528 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:07.446350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb85d83-d8cc-4b3f-ad89-c86a0db55528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:07.474403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7fb85d83-d8cc-4b3f-ad89-c86a0db55528 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:07.475626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7fb85d83-d8cc-4b3f-ad89-c86a0db55528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:07.523698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:07.552199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 170/336] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:07.796179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d512-5352-4a27-941c-864470acf0f2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:07.796538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d512-5352-4a27-941c-864470acf0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:07.796639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29d512-5352-4a27-941c-864470acf0f2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:07.798295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 167/337] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:07.804203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:07.804726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:07.805219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:07.827801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:07.829388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:07.911680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 171/338] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:07.969861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29d512-5352-4a27-941c-864470acf0f2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:08.012101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:08.108118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29d512-5352-4a27-941c-864470acf0f2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:08.160116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:08.160761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.161038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.161313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.186530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:08.192656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:08.194401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:08.195924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 168/339] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:08.202209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:08.334463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:08.361328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b14f3-91cd-4c7a-95a5-538ee98daa69 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:08.382842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:08.439535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:08.440155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.440457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.440737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.441439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:08.441746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:08.443128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837d1f0-c7ed-4ed2-8948-7cc49c731aa7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:08.460674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 172/340] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:08.463488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c2ad-b50f-4e0d-be23-692f535ef81f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.463799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c2ad-b50f-4e0d-be23-692f535ef81f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.464023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419c2ad-b50f-4e0d-be23-692f535ef81f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.465512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 173/341] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:08.474624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.475191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.476205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.507318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:08.517126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa069b7-6a87-4f1f-8e51-a0996704ac3c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:08.517956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:08.519435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:08.557462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:08.558249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.558535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.558814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.572872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:08.578151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:08.579083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:08.580324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 169/342] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:08.583241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:08.699303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd85ecc-6e15-40c0-b408-4e0886382388 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:08.719606 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 174/343] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:08.720828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:08.738720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:08.739341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.739621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.739895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.775547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:08.855349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:08.856851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:08.905792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:08.912027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c7c67-0255-420e-9f1d-2068d04ca01c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:08.963336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:08.964084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:08.964463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:08.964837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:08.965620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:08.965924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:08.967320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:08.985455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 175/344] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:08.996416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.027549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 170/345] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:09.034850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.177595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:09.205803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106e3c4-7be1-4056-917f-3fe18c822cdd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.241658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f654a5-dfe3-472e-a85b-d0f541e75bc7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.246547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab1e47-43df-4738-aa67-996dd28d30c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.247177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab1e47-43df-4738-aa67-996dd28d30c7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.247456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab1e47-43df-4738-aa67-996dd28d30c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.247727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab1e47-43df-4738-aa67-996dd28d30c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.286333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa175341-ac05-48c2-967b-c560353f1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.286605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:09.286965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175341-ac05-48c2-967b-c560353f1787 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.287234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175341-ac05-48c2-967b-c560353f1787 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.287502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa175341-ac05-48c2-967b-c560353f1787 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.288693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa175341-ac05-48c2-967b-c560353f1787 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:09.290226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa175341-ac05-48c2-967b-c560353f1787 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:09.292257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 171/346] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:09.293473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec2395-e7c1-444a-9117-e033b7268a13 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.293751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec2395-e7c1-444a-9117-e033b7268a13 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.294021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec2395-e7c1-444a-9117-e033b7268a13 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.295513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 172/347] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:09.296245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec2395-e7c1-444a-9117-e033b7268a13 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.335409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab1e47-43df-4738-aa67-996dd28d30c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:09.337010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab1e47-43df-4738-aa67-996dd28d30c7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:09.420896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec2395-e7c1-444a-9117-e033b7268a13 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.442450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:09.455680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 176/348] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:09.457682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.458069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.458307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.463532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.464168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.464432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.464688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.478834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:09.479751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:09.480037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:09.484518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:09.487944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 173/349] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:09.499365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.568888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:09.580881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 177/350] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:09.582537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.646156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5698849-6d49-49d8-ba3c-35b916bb2a95 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.695482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.696497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.697601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.698084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.709939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:09.712376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:09.715097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 174/351] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:09.716134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.721091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2f6f2-041c-4288-8e46-5db94e09181f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.769060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdff6a-f47d-431b-9661-50db15221537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.770716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdff6a-f47d-431b-9661-50db15221537 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.771005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdff6a-f47d-431b-9661-50db15221537 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.771277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdff6a-f47d-431b-9661-50db15221537 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.772572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdff6a-f47d-431b-9661-50db15221537 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:09.774076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdff6a-f47d-431b-9661-50db15221537 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:09.776079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 178/352] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:09.777396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:09.778858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3cb4-d9a6-48dc-b4a5-e79515fd2c6a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.779162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3cb4-d9a6-48dc-b4a5-e79515fd2c6a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.779500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc3cb4-d9a6-48dc-b4a5-e79515fd2c6a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.785320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 179/353] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:09.785320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3cb4-d9a6-48dc-b4a5-e79515fd2c6a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.868838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4545-ea68-4831-9ed6-cbb665d9488a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.871986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:09.923133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.924336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.925319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.926282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.927169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:09.927930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:09.929610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:09.937525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc3cb4-d9a6-48dc-b4a5-e79515fd2c6a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:09.941317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 175/354] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:09.942396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:09.990380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:09.991302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:09.992084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:09.993242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:09.993242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=cb7426167797495c89da5ca88d7a02f3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:09.993501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:09.994975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3108f62-653e-4d70-b981-e45031681206 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:10.005537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 180/355] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=d0ec590bde8e414995f352abf7f10ace => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:10.007299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.007586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.007860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.036107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:10.037282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:10.102335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65f4ce-3f0c-4c0c-b7b8-887f01bb64de None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.111508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:10.137139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 181/356] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:10.138399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:10.182291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:10.182936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.183217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.183483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.186115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:10.187588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:10.189598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 176/357] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:09 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:10.190505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:10.231394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:10.303660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb938611-343a-4136-bde7-3260e8410884 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.341278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed93b0-ccec-460e-aa09-062101ad7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:10.341932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed93b0-ccec-460e-aa09-062101ad7dcc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.342214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed93b0-ccec-460e-aa09-062101ad7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.342492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed93b0-ccec-460e-aa09-062101ad7dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.343338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2980f-20bd-4a2f-86ca-501178dd187e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.401319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:10.401865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:10.402266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.402542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.402815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.418332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:10.423207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:10.424269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 182/358] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:10.426157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:10.431247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed93b0-ccec-460e-aa09-062101ad7dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:10.433013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed93b0-ccec-460e-aa09-062101ad7dcc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:10.544965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecc262-095e-44d1-9764-7fcab5aaa2cc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.556025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 177/359] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:10.557682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f27c0-9ad7-422d-b516-4648ab380ac8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.558243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f27c0-9ad7-422d-b516-4648ab380ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.558832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f27c0-9ad7-422d-b516-4648ab380ac8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.560337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 178/360] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:10.561340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f27c0-9ad7-422d-b516-4648ab380ac8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:10.566951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:10.593583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:10.594194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.594467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.594732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.595466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=cb7426167797495c89da5ca88d7a02f3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:10.595771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:10.597894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:10.611555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 183/361] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:10.612520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:10.673389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:10.721088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f27c0-9ad7-422d-b516-4648ab380ac8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.769380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5566-6e99-4a3d-a66f-d93e32fe010a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.772519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:10.773784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.774304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.774779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.775716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:10.776230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:10.777989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:10.791391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 179/362] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:10.792621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:10.815420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c25bac-fd5b-48cd-b685-98af200dff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:10.816065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25bac-fd5b-48cd-b685-98af200dff45 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.816341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25bac-fd5b-48cd-b685-98af200dff45 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.816607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c25bac-fd5b-48cd-b685-98af200dff45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.832584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c25bac-fd5b-48cd-b685-98af200dff45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d5c25bac-fd5b-48cd-b685-98af200dff45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:10.838860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:10.839780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:10.840587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 184/363] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:10.841246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:10.841941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:10.841941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:10.865101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:10.866405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:10.914566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:10.937687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407ce1a-3fef-4475-a7b9-b4b356b04e7d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:10.969219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 185/364] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:10.971859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.022656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.023690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.024484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.024998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.027672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.029541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.031620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 180/365] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:11.032650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.038102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:11.169753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac615c16-4aa6-4993-93b4-65ea85263a2e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.237981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77eea76-f9a0-43df-a6c2-7ced23d60cfb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.239106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.239757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.240041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.240315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] PATH_INFO: `/v3/users/3a5e1a8c44d541849cafe03fea5b8473` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.242626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] RBAC: Authorizing `identity:get_user(user_id=3a5e1a8c44d541849cafe03fea5b8473)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.245128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.247186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 186/366] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:28:10 2022] GET /identity/v3/users/3a5e1a8c44d541849cafe03fea5b8473 => generated 293 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:11.247972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.296561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.298170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.298650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.299312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.301495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:11.302006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.303806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.315239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 181/367] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:11.316118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:11.317131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.413656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:11.441973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0ec9-1a37-4691-ae22-d3e22ae3d041 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.464668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c3157-abda-4d63-ad63-372a8651f2e1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.483607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.484608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.484608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.484950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.486227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.488309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.490228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 187/368] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:11.490863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.521814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.522766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.523258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.523761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.524705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] RBAC: Adding query filter params (role.id=4464d6860e5f43449760b1be307f75d8, user.id=3a5e1a8c44d541849cafe03fea5b8473, scope.system=all) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:11.525237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.526998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.540596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 182/369] 10.222.0.67 () {56 vars in 1308 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/role_assignments?user.id=3a5e1a8c44d541849cafe03fea5b8473&scope.system=all&role.id=4464d6860e5f43449760b1be307f75d8 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:11.541922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.611716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca06312-df8d-4a7e-b901-be63dbcf8d71 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.614953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:11.650760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.651476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.652805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.653147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.669958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da3f85-de68-4462-8deb-341abd3477d5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.705559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:11.725581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.726985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.727728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.728323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.740960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.742694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.746975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:11.757020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:11.757974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:11.758783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:11.761260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 183/370] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:11.762331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.855854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 188/371] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:11.856892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.860823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:11.917002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66daba7-b1af-4384-a58f-6c7a0bfb0780 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:11.957463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:11.958019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:11.958300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:11.958568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:11.959299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=b2cb145507b2455090e4df43802bd1bb) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:11.959604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:11.961063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:11.967488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 184/372] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=d0ec590bde8e414995f352abf7f10ace => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:11.968307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:11.971044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec244e-d1c6-41fb-919f-42bfdfaa05fa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:12.016368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:12.017025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.017303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.017608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.018287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:12.019119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:12.020566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:12.030557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 189/373] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:12.042240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:12.052625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:12.115067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c0dcf-0434-46af-83b2-b59fc1053742 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:12.141259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:12.167611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:12.168258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.168533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.168823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.169993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:12.171458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:12.173739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 185/374] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:11 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:12.179133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:12.248366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdfc9-bf18-4d73-ab02-a3e31c9bf0bd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:12.294282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e4f2b-857b-4e91-a134-bcfc91687525 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:12.313759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:12.333171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:12.333871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.334150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.334254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:12.334426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.334838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.335220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.335501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.336790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:12.338610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:12.340792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 186/375] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:12 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:12.350498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:12.455521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:12.458666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:12.520806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc8ad7-cd72-4486-9445-fa6962c1d2db None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:12.561191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:12.561824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.562100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.562370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.563104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=b2cb145507b2455090e4df43802bd1bb) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:12.563408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:12.564900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4954ebf-3736-4dea-b0af-b11e26d827b8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:12.574382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 187/376] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:12 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:12.615390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abab7-287d-42b9-9577-e5aaeddbd5b0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.615735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abab7-287d-42b9-9577-e5aaeddbd5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.616027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601abab7-287d-42b9-9577-e5aaeddbd5b0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.617763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 188/377] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:12.623177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.623573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.623942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.624610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:12.656654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:12.658352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:12.716552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 190/378] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:12.722293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:12.733393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:12.799133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 189/379] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:12.850081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380edf9-c43a-4ffc-acbe-c9d39eed16de None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:12.893474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:12.894568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:12.895066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:12.895513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] PATH_INFO: `/v3/projects/7fd422d7b4374b2da837eb380d608b2e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:12.896679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] RBAC: Authorizing `identity:get_project(project_id=7fd422d7b4374b2da837eb380d608b2e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:12.898241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:12.901415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 191/380] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:12 2022] GET /identity/v3/projects/7fd422d7b4374b2da837eb380d608b2e => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:12.906600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:13.054263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35af8da-6f86-4ad9-8acb-e1cd8f1c2d29 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:13.105994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:13.106982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.107462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.107928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] PATH_INFO: `/v3/groups/b9255a742b234941b5b2d99bf0920ee3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.118342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] RBAC: Authorizing `identity:get_group(group_id=b9255a742b234941b5b2d99bf0920ee3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:13.120119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:13.122297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 190/381] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:12 2022] GET /identity/v3/groups/b9255a742b234941b5b2d99bf0920ee3 => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:13.128343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:13.166549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:13.199004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:13.278013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:13.295034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1b9da-15f4-4521-94f6-64ea332874ba None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:13.337650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:13.338490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.338988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.339749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.340674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] RBAC: Adding query filter params (group.id=b9255a742b234941b5b2d99bf0920ee3, role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=7fd422d7b4374b2da837eb380d608b2e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:13.341186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:13.342862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de9f0-41d0-4f6d-a8ad-036b5b232a85 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:13.349744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 192/382] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:13 2022] GET /identity/v3/role_assignments?group.id=b9255a742b234941b5b2d99bf0920ee3&scope.project.id=7fd422d7b4374b2da837eb380d608b2e&role.id=0c9309017d3143658120ff04160bea6f => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:13.350906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870e008-5ef2-48b9-81b3-3d7516b44ad8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:13.351305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835678-14fd-4393-b43f-9e48b59fc31d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.351734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835678-14fd-4393-b43f-9e48b59fc31d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.352155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1835678-14fd-4393-b43f-9e48b59fc31d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.358487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 193/383] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:13.364268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.364733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.365241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.397258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:13.397965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.398239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.398509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.401890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:13.403470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:13.417055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:13.424084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:13.425076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:13.425900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:13.429512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 191/384] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:13.433331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:13.592789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 194/385] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:13.600127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e6031-7a33-4066-bf68-d4acf9f0d93b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:13.602065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:13.647645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:13.648247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.648519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.648788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.649501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:13.649798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:13.651174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:13.662478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 192/386] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:13.669099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:13.718210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:13.808070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3abd8-b4f2-4993-b306-08da2fcc9002 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:13.852144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:13.852717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:13.853001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:13.853273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:13.854439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:13.855894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:13.857843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 195/387] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:13 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:13.863600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:14.001074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0146a-62be-4d0f-aa55-84975d0f7ac9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:14.042425 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:14.043068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.043344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.043614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.044796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:14.046311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:14.048351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 193/388] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:13 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:14.054213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:14.095218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:14.140075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:14.189374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00565b03-9385-4571-927d-3d709c6b248b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:14.213734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:14.223262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:14.223932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.224311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.224592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.226509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb7426167797495c89da5ca88d7a02f3, group_id=158201c08fd94cdc85118c1ff5f66e1f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:14.228190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:14.243661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 196/389] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Aug 29 23:28:14 2022] PUT /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:14.263707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dba74-a998-4d10-80c6-260da6d96cb4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:14.312950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939be19-d070-4241-b8ff-83279512bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:14.313642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939be19-d070-4241-b8ff-83279512bfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.313912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939be19-d070-4241-b8ff-83279512bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.314185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939be19-d070-4241-b8ff-83279512bfe9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.331463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939be19-d070-4241-b8ff-83279512bfe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6939be19-d070-4241-b8ff-83279512bfe9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:14.336708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:14.337967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:14.338805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:14.340964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 194/390] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:14.346393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:14.514589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469277cc-1d52-4e80-8c48-f70a2422b068 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:14.538897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4c65-41a7-4d19-bf87-e66a2d169bca None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.539524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4c65-41a7-4d19-bf87-e66a2d169bca None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.540009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e4c65-41a7-4d19-bf87-e66a2d169bca None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.542633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 195/391] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:14.548608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.549138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.550204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.555155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:14.555813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.556033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.556301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.556976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:14.557274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:14.559518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:14.572718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 197/392] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:14.575611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:14.581413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:14.582848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:14.605067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:14.685634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 196/393] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:14.716257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b3c398-e833-4c65-91f6-58f507484525 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:14.756868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:14.757535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.757816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.758202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.759367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:14.760827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:14.762433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 198/394] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:14 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:14.768237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:14.811954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:14.899366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aea2e4-3f18-43d3-ad3f-89d2dd7d6447 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:14.943537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:14.944188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:14.944461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:14.944735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:14.946010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:14.947509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:14.953841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 197/395] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:14 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:14.959475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:15.021764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:15.073327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:15.090686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ab4a4-2519-4d2c-80db-b4f2862a6d5c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:15.131238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:15.131906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.132187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.132459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.136093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cb7426167797495c89da5ca88d7a02f3, group_id=158201c08fd94cdc85118c1ff5f66e1f, role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:15.137579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:15.169061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 199/396] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Aug 29 23:28:14 2022] PUT /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:15.206499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:15.219414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68685687-64f2-45fa-9a75-4b8d8b5166ef None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:15.289653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09290ef-fef7-40d0-aa33-69d783da3208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:15.290215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09290ef-fef7-40d0-aa33-69d783da3208 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.290489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09290ef-fef7-40d0-aa33-69d783da3208 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.290753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09290ef-fef7-40d0-aa33-69d783da3208 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.307346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09290ef-fef7-40d0-aa33-69d783da3208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a09290ef-fef7-40d0-aa33-69d783da3208 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:15.312183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:15.313075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:15.313983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:15.315539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 198/397] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:15.325887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:15.458417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da0c0c-50ea-4412-bbb9-4e3fd650d9d9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:15.476824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685a21-af0e-45ab-a2fd-2852fec242b0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.477294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685a21-af0e-45ab-a2fd-2852fec242b0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.477435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685a21-af0e-45ab-a2fd-2852fec242b0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.479952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 199/398] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:15.485061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.485340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.485653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.497484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:15.498461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.498951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.499420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.500282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:15.500802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:15.502482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:15.512749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 200/399] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:15.519201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:15.524183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:15.524599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:15.532001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:15.637257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef77d06-aaba-48ce-a51b-e666852b34a4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:15.679006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:15.680194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.680800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.681476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.686460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:15.688811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:15.689765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 200/400] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:15.692555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 201/401] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:15 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:15.698192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:15.785843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:15.807308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11470b-93f2-47c4-bb0e-684c1d1f793b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:15.844088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d027a-5d5e-494f-94c5-d1ecb044fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:15.845066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d027a-5d5e-494f-94c5-d1ecb044fb2c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.845598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d027a-5d5e-494f-94c5-d1ecb044fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.846079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d027a-5d5e-494f-94c5-d1ecb044fb2c None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.847485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d027a-5d5e-494f-94c5-d1ecb044fb2c None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:15.849131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d027a-5d5e-494f-94c5-d1ecb044fb2c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:15.851045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 201/402] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:15 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:15.857170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:15.945672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:15.970027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44d6c-96b4-47a5-bef2-46a7c72bb3c6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.970980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44d6c-96b4-47a5-bef2-46a7c72bb3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.971487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44d6c-96b4-47a5-bef2-46a7c72bb3c6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:15.976681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c176-5235-4887-a5b5-506de5c47b69 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:15.977211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 202/403] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:28:15.980364 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:15.980886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:15.981394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.003594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:16.005506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:16.047786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:16.048819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:16.050291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:16.050785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.053610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb145507b2455090e4df43802bd1bb, group_id=158201c08fd94cdc85118c1ff5f66e1f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:16.058815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:16.081769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 202/404] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Aug 29 23:28:15 2022] PUT /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:16.101069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 203/405] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:16.129312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.246414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcf557-5578-40c0-9fdf-cd6089751417 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:16.281484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:16.282110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:16.282374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:16.282642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.285849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:16.295728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:16.301379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:16.302249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:16.303033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 203/406] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:16.310839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.402117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:16.435704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1b3db-e811-4dc4-810c-f19144aee36f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:16.469227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.476850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:16.477497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:16.477775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:16.478052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.478728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:16.479026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:16.480397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:16.489444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 204/407] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:16.503212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.606060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a5cf6-0c5d-4ba7-ae6e-8515ab9f8d73 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:16.652630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:16.653268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:16.653565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:16.653836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.677971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:16.691798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:16.692749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:16.693584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:16.695782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 204/408] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:16.701529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.716815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51f7d-21c9-423d-b56d-b404a0030e31 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:16.753951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:16.754897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:16.755178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:16.755450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.756580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:16.758175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:16.760135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 205/409] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:16 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:16.766239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.789706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:16.881113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e406aaad-c0b4-4b51-b19c-ce0eef89c6ba None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:16.887117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:16.934649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:16.935286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:16.935865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:16.936134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:16.937989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:16.939633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:16.945181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 206/410] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:16 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:16.955045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:16.981618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b5a22-a419-4195-9a8e-ba93b81ff482 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:17.024772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:17.025857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.026356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.026868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.027742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:17.028274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:17.030096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaab84-1fd9-4429-b799-28e672a077d8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:17.039415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 205/411] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:17.041106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ac652-b0bd-4e6b-a7ae-af309ae182ff None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.041630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ac652-b0bd-4e6b-a7ae-af309ae182ff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.042186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ac652-b0bd-4e6b-a7ae-af309ae182ff None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.043986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 206/412] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:17.048702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ac652-b0bd-4e6b-a7ae-af309ae182ff None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:17.073725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:17.090212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0523-80fc-4c6d-9ddf-e1a7477ae69a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:17.135438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25a04a-6d86-4fed-9d6c-93164dfc9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:17.136644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a04a-6d86-4fed-9d6c-93164dfc9ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.137240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a04a-6d86-4fed-9d6c-93164dfc9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.137543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25a04a-6d86-4fed-9d6c-93164dfc9ef5 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.140778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25a04a-6d86-4fed-9d6c-93164dfc9ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2cb145507b2455090e4df43802bd1bb, group_id=158201c08fd94cdc85118c1ff5f66e1f, role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:17.144513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef25a04a-6d86-4fed-9d6c-93164dfc9ef5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:17.160710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ac652-b0bd-4e6b-a7ae-af309ae182ff None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:17.177822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 207/413] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Aug 29 23:28:16 2022] PUT /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb/groups/158201c08fd94cdc85118c1ff5f66e1f/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:28:17.177822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.177822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.177822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.196045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:17.217939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:17.219185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:17.227060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:17.227743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.228031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.228352 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] PATH_INFO: `/v3/groups/b9255a742b234941b5b2d99bf0920ee3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.229807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] RBAC: Authorizing `identity:get_group(group_id=b9255a742b234941b5b2d99bf0920ee3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:17.234054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:17.239043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 207/414] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:17 2022] GET /identity/v3/groups/b9255a742b234941b5b2d99bf0920ee3 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:17.246248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:17.347001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 208/415] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:17.411948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb07c1-a03f-4654-9ea2-0a463ab93d71 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:17.449236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32328-1a13-44c8-9592-d1b2be508878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:17.450224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32328-1a13-44c8-9592-d1b2be508878 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.450698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32328-1a13-44c8-9592-d1b2be508878 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.451113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32328-1a13-44c8-9592-d1b2be508878 None admin] PATH_INFO: `/v3/projects/7fd422d7b4374b2da837eb380d608b2e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.452494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32328-1a13-44c8-9592-d1b2be508878 None admin] RBAC: Authorizing `identity:get_project(project_id=7fd422d7b4374b2da837eb380d608b2e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:17.454123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad32328-1a13-44c8-9592-d1b2be508878 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:17.456323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 208/416] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:17 2022] GET /identity/v3/projects/7fd422d7b4374b2da837eb380d608b2e => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:17.462005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:17.581720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:17.611015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b54bd-0fac-4ea4-96d1-f91137a02de4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.611298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b54bd-0fac-4ea4-96d1-f91137a02de4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.611574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694b54bd-0fac-4ea4-96d1-f91137a02de4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.613469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 209/417] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:17.619500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abb1f1-dcee-4796-80ef-13cdb5bbbdf7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:17.623533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.623814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.624086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.643597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:17.644805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:17.666599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:17.667393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.667669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.667942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] PATH_INFO: `/v3/projects/7fd422d7b4374b2da837eb380d608b2e/groups/b9255a742b234941b5b2d99bf0920ee3/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.669970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7fd422d7b4374b2da837eb380d608b2e, group_id=b9255a742b234941b5b2d99bf0920ee3, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:17.671671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:17.688543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 209/418] 10.222.0.67 () {58 vars in 1442 bytes} [Mon Aug 29 23:28:17 2022] PUT /identity/v3/projects/7fd422d7b4374b2da837eb380d608b2e/groups/b9255a742b234941b5b2d99bf0920ee3/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:17.689519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:17.708721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:17.741373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 210/419] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:17.821505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239ca60-79e9-43d7-baa1-46b3b9a808e9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:17.852856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:17.863292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:17.864068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:17.864786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:17.865066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:17.877707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:17.883074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:17.884028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:17.885276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 210/420] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:17.890879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.002149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871f66-48e3-4f88-910e-5a19f93d7eda None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.051705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.053395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.054387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.054666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.054938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.055680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] RBAC: Adding query filter params (name=member) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:18.055979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:18.057531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:18.080368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 211/421] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:18.086336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.139733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:18.227897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb9b9f-41f2-4b06-9a7d-ded87a6b4bbf None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.298204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.298830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.299113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.299384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.308155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be169-a56f-4568-84eb-ae8ace98916c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.375944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.376931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.377436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.378435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.400661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:18.411480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:18.412542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:18.413321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:18.416586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 211/422] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:18.422633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.434328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:18.435935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:18.485842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:18.534809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:18.554863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 212/423] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:18.561139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.621109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c65d59f-e85d-4e36-81fd-41c5fe033315 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.659202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.659724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.660004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.660275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.660944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:18.661360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:18.662835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e05df-9ef3-4657-8621-fb7d0171e56d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:18.670934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81dd692-a015-4dd8-9a86-e4f33a017f7a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.671895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 212/424] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:18.677716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e064-2895-4201-94e6-4ac573bf987b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.678002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e064-2895-4201-94e6-4ac573bf987b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.678278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4e064-2895-4201-94e6-4ac573bf987b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.679940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 213/425] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:18.680826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e064-2895-4201-94e6-4ac573bf987b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.719280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef489a-f5af-4022-9ee7-d2adc3274514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.720181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef489a-f5af-4022-9ee7-d2adc3274514 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.720460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef489a-f5af-4022-9ee7-d2adc3274514 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.720731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef489a-f5af-4022-9ee7-d2adc3274514 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.722743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef489a-f5af-4022-9ee7-d2adc3274514 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:18.724188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef489a-f5af-4022-9ee7-d2adc3274514 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:18.730719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 213/426] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:18 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:18.731850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.732138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.732414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.759603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:18.761969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:18.776203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:18.812505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4e064-2895-4201-94e6-4ac573bf987b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:18.822957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:18.853302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 214/427] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:18.854517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:18.866392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:18.867345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:18.867849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:18.868324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:18.953235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:18.955046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.081617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 214/428] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:19.088844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.095964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4cf93-a215-4d80-8323-60f0b02838f0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.110260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:19.168719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.169364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.169644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.169912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.172109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:19.173636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.177049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 215/429] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:18 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:19.181974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.205036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:19.282911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e39ed0-2b31-486f-ada7-4cb07d25bf5f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.325999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.326674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.326934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.327208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] PATH_INFO: `/v3/projects/cb7426167797495c89da5ca88d7a02f3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.328338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] RBAC: Authorizing `identity:get_project(project_id=cb7426167797495c89da5ca88d7a02f3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:19.329823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.331463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b7971-c344-43c1-9cff-fd1f69dc2bb5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.331899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 215/430] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/projects/cb7426167797495c89da5ca88d7a02f3 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:19.332758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.373793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.374780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.375263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.375760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.376762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=cb7426167797495c89da5ca88d7a02f3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:19.377953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:19.380212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.389569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 216/431] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=d0ec590bde8e414995f352abf7f10ace => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:19.391362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.441332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:19.474317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b99dc4-c024-4504-bf83-33b037fe4b53 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.546941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ff62-9058-4aa8-987a-3abac4e69d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.547962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ff62-9058-4aa8-987a-3abac4e69d84 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.548455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ff62-9058-4aa8-987a-3abac4e69d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.548936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ff62-9058-4aa8-987a-3abac4e69d84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.561435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ff62-9058-4aa8-987a-3abac4e69d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:19.561640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-13b7ff62-9058-4aa8-987a-3abac4e69d84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:19.567113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:19.568154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 29 23:28:19.569125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:19.571005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 216/432] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:19.575774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c3ff9-14e9-4c58-b415-5addb93aee82 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.575774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c3ff9-14e9-4c58-b415-5addb93aee82 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.575774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c3ff9-14e9-4c58-b415-5addb93aee82 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.576282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 217/433] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:19.578239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c3ff9-14e9-4c58-b415-5addb93aee82 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.589150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f1756-1005-45cc-83f7-8474805bab9e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.640179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9cf44-3865-45ea-806c-62330506abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.640812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cf44-3865-45ea-806c-62330506abc1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.641092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cf44-3865-45ea-806c-62330506abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.641453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9cf44-3865-45ea-806c-62330506abc1 None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.643654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9cf44-3865-45ea-806c-62330506abc1 None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:19.644907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9cf44-3865-45ea-806c-62330506abc1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.648534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 217/434] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:19.650836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.650836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.650836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.673620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:19.675842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:19.729160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c3ff9-14e9-4c58-b415-5addb93aee82 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.761400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 218/435] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:19.762269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.783751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.784365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.784643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.784912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.785635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:19.785939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:19.787560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.790667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:19.805849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 218/436] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:19.808885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:19.874116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:19.911121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d62a-8f67-49a6-8f71-7caf64d92980 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.944179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207d84d-c455-4a43-9ac8-37f416582af7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:19.954807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.954807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.954807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.954807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.955199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=cb7426167797495c89da5ca88d7a02f3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:19.955199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:19.956903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a51cce-ad51-4685-82e8-18e32c57e865 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:19.964216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 219/437] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=cb7426167797495c89da5ca88d7a02f3&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:19.964599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3739-b056-4db2-94e9-40e081907ede None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.964815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3739-b056-4db2-94e9-40e081907ede None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.965253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3739-b056-4db2-94e9-40e081907ede None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.967289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 220/438] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:19.973812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:19.974152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:19.974370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:19.994311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:19.995456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:19.997850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:19.999776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.000306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.000787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.081570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 221/439] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:20.082592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.091335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.092978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.113789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.161385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.210785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3d97-87e6-4d9a-9f1a-180f16b2ec03 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.230421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 219/440] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 29 23:28:20.235938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.260988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.262652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.263001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.263373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.285422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:20.290386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:20.291474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:20.292360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 222/441] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:20.301020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.375065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.380917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e8892-bb43-44ff-aa16-246c22b43302 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.421935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.422648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.422927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.423191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.424304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.425845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.427554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 220/442] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:20.428334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.430727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc471-cd0a-4d53-9c6d-836f079319e7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.458333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.466923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.467522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.467801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.468070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.468731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:20.469035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.470484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.479673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 223/443] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:20.480655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.530995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f91589-3781-4a4b-b4f4-a6fa2ae7f570 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.565603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.566264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.566545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.566815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.577184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:20.579148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4bf6f0-8279-4e17-92b7-99fe7939f45a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:20.582528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:20.583400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:20.584196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 221/444] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:20.584845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.612348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.617967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.618597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.618878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.619151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.620396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.621754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.623327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 224/445] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:20.624084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.685251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.686212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42046031-6ab0-4c14-bcf1-23f7acd748ee None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.721805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.722409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.722689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.722960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.728501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fec283-0721-4989-98da-303d5d53651e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.761530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.762393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.762818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.763252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.764244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:20.764726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.767009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.775607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 225/446] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:20.776398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.792258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.793657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.819414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.876121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6f701-e66a-4ef8-965e-9228c43cdb17 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:20.894619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 222/447] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:20.895472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:20.899877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:20.914660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:20.915261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:20.915536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:20.915806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:20.916563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=d0ec590bde8e414995f352abf7f10ace, scope.project.id=b2cb145507b2455090e4df43802bd1bb) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:20.916869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:20.918333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:20.924468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 226/448] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=d0ec590bde8e414995f352abf7f10ace => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:20.925235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:21.020916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b92cd5-15b7-493e-8984-a408a8ba2db5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.039641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5a952-027e-4a76-8cb1-f2db070536f8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.053510 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:21.065722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.066362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.066639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.066905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.082215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.082869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.083154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.083437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] PATH_INFO: `/v3/projects/b2cb145507b2455090e4df43802bd1bb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.084584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b2cb145507b2455090e4df43802bd1bb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.086988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.088131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 227/449] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/projects/b2cb145507b2455090e4df43802bd1bb => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:21.093626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:21.164047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:21.168526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.169521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.223132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040afe8-5b78-4c9b-8caf-e8a55676a6a9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.266086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.267096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.267589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.267867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] PATH_INFO: `/v3/groups/158201c08fd94cdc85118c1ff5f66e1f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.269105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] RBAC: Authorizing `identity:get_group(group_id=158201c08fd94cdc85118c1ff5f66e1f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.270851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.272899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 228/450] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:21 2022] GET /identity/v3/groups/158201c08fd94cdc85118c1ff5f66e1f => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:21.278372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:21.290745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 223/451] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:21.296363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:21.323586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:21.385266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b0656-7062-488a-bce3-4b7557838df3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.397133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c72bc-9d8e-4183-b26e-c5b1f0d147a7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.404405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:21.419846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.420442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.420723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.420989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.421722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] RBAC: Adding query filter params (group.id=158201c08fd94cdc85118c1ff5f66e1f, role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=b2cb145507b2455090e4df43802bd1bb) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:21.422024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.423456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.430170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 229/452] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:21 2022] GET /identity/v3/role_assignments?group.id=158201c08fd94cdc85118c1ff5f66e1f&scope.project.id=b2cb145507b2455090e4df43802bd1bb&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:21.440346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.441022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.441295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.441611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] PATH_INFO: `/v3/projects/7fd422d7b4374b2da837eb380d608b2e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.442811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=7fd422d7b4374b2da837eb380d608b2e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.444309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.446067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 224/453] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:28:21 2022] GET /identity/v3/projects/7fd422d7b4374b2da837eb380d608b2e => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:21.451848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:21.557901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649f0c5-c843-4544-a91c-613b059ace13 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.592908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33468dd-7c3e-458b-93ce-18bb608f5448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.593659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33468dd-7c3e-458b-93ce-18bb608f5448 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.593938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33468dd-7c3e-458b-93ce-18bb608f5448 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.594207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33468dd-7c3e-458b-93ce-18bb608f5448 None admin] PATH_INFO: `/v3/groups/b9255a742b234941b5b2d99bf0920ee3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.595318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33468dd-7c3e-458b-93ce-18bb608f5448 None admin] RBAC: Authorizing `identity:get_group(group_id=b9255a742b234941b5b2d99bf0920ee3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.597244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33468dd-7c3e-458b-93ce-18bb608f5448 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.601026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 230/454] 10.222.0.67 () {56 vars in 1180 bytes} [Mon Aug 29 23:28:21 2022] GET /identity/v3/groups/b9255a742b234941b5b2d99bf0920ee3 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:21.604653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:21.700044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:21.707860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d6fc6-29c9-456c-b2a9-5c40df8f5fd6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:21.747510 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:21.748114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:21.748392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:21.748651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:21.749401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] RBAC: Adding query filter params (group.id=b9255a742b234941b5b2d99bf0920ee3, role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=7fd422d7b4374b2da837eb380d608b2e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:21.749704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:21.751130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea1cdd-2434-4044-996b-4ca4009dd850 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:21.757404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 225/455] 10.222.0.67 () {56 vars in 1376 bytes} [Mon Aug 29 23:28:21 2022] GET /identity/v3/role_assignments?group.id=b9255a742b234941b5b2d99bf0920ee3&scope.project.id=7fd422d7b4374b2da837eb380d608b2e&role.id=0c9309017d3143658120ff04160bea6f => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:24.146442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57d45-8fd5-4e6e-9b47-e78519d8072d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.146442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57d45-8fd5-4e6e-9b47-e78519d8072d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.146442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57d45-8fd5-4e6e-9b47-e78519d8072d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.147569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 231/456] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:24.153994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325531c7-2326-4886-869f-724329ebbe8f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.154821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325531c7-2326-4886-869f-724329ebbe8f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.155294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325531c7-2326-4886-869f-724329ebbe8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.178322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-325531c7-2326-4886-869f-724329ebbe8f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:24.179504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-325531c7-2326-4886-869f-724329ebbe8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:24.274973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 226/457] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:24.357231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7fd9-af16-47f1-bf58-a6cbdcb63fe6 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.357882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7fd9-af16-47f1-bf58-a6cbdcb63fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.358412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d7fd9-af16-47f1-bf58-a6cbdcb63fe6 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.360163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 232/458] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:24.366521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bb3a-a816-4f0b-bbb7-a6c1ffcff3e9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.367091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bb3a-a816-4f0b-bbb7-a6c1ffcff3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.367567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408bb3a-a816-4f0b-bbb7-a6c1ffcff3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.391358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0408bb3a-a816-4f0b-bbb7-a6c1ffcff3e9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:24.392562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0408bb3a-a816-4f0b-bbb7-a6c1ffcff3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:24.496002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 227/459] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:24.609158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7fd9-af16-47f1-bf58-a6cbdcb63fe6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:24.683906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:24.753467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d7fd9-af16-47f1-bf58-a6cbdcb63fe6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:24.792872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:24.793537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.793793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.794067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.808173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:24.809659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:24.812208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b360-f031-4b54-b1b0-a709a1326183 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.812731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b360-f031-4b54-b1b0-a709a1326183 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.813204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712b360-f031-4b54-b1b0-a709a1326183 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.816079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 228/460] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:24.820494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:24.821175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:24.821690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:24.828006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:24.828928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:24.830466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:24.830466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:24.830466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:24.830466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 233/461] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:24.834225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:24.850408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:24.851926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:24.929721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:24.930081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 229/462] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:24.931644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:24.957381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be3a7-20af-4023-9675-e27364a52a25 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:24.961059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.003150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.003985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.004330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.004696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.016108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.017784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7b656b19-589d-4f9e-84ba-ac70d4cf5efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:25.033549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:25.035046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:25.035883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:25.035883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:25.035883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:25.035883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 234/463] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:25.037137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0165c-b30a-4ba1-8c83-5a96397f6580 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.037905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0165c-b30a-4ba1-8c83-5a96397f6580 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.038251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0165c-b30a-4ba1-8c83-5a96397f6580 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.039694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 235/464] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:25.044448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0165c-b30a-4ba1-8c83-5a96397f6580 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.064739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3db732-0967-4a05-83bf-a0e4bdc11c3c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.114115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.114811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.115086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.115504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.116196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:25.116810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.118554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314f1a3-994c-4f40-b08b-8bd17a6ca885 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.134435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 230/465] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:25.135718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.136005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.136271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.167968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:25.169718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:25.172461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.175773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0165c-b30a-4ba1-8c83-5a96397f6580 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.223562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.224183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.224464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.224740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.225557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:25.225716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.227120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.241394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 236/466] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:25.241394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.250179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 231/467] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:25.254346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.270184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.360226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f9d94-e30a-4a0a-b63c-37f0b48e378f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.388202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce7e7f-1f7a-4856-84fe-a71a16f52f16 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.399799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.400567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.400947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.401342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.409235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.414498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.416621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.427055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.427905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.428451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.428905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.429775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.431400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:25.433709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:25.434598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:25.435489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:25.435489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:25.435489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:25.435489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 232/468] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:25.438127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.470247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 237/469] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:28:25 2022] POST /identity/v3/users => generated 246 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:25.472034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.556320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.564294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf9571-d840-450d-9e94-a491de622b1c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.593497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b77f3b-2e2d-4583-a505-9681e9c3a32a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.605232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.606052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.606435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.606822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.607681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.609385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.641637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 233/470] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:28:25 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:25.642787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.644581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.645283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.646416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.647281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.650335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:25.650860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.653126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.680419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 238/471] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:25.686747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.727827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.810943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee51db-5b94-413c-ac22-e65f7c284f0e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.835905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9144cc-d6ba-4aae-8560-515f69a39996 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:25.855730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.857017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.857301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.857603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.872292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.874075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.877578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:25.888074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fe7e9-92a0-4981-ad4d-da4deba2acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:25.888698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe7e9-92a0-4981-ad4d-da4deba2acf7 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.888981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe7e9-92a0-4981-ad4d-da4deba2acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.889256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fe7e9-92a0-4981-ad4d-da4deba2acf7 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.889958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe7e9-92a0-4981-ad4d-da4deba2acf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:25.891425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fe7e9-92a0-4981-ad4d-da4deba2acf7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b44ab8f2-ee32-4bb2-a7ed-3b96ca12baca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:25.899875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:25.900908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 234/472] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c22e2-a9cf-4aa4-8953-40a9d81544b4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c22e2-a9cf-4aa4-8953-40a9d81544b4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c22e2-a9cf-4aa4-8953-40a9d81544b4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.901830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 235/473] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:25.905216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c22e2-a9cf-4aa4-8953-40a9d81544b4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:25.928591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 239/474] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:28:25 2022] POST /identity/v3/users => generated 249 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:25.930000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:25.930362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:25.930709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:25.970495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:25.972388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:26.073743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:26.079973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c22e2-a9cf-4aa4-8953-40a9d81544b4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:26.133463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 240/475] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:26.143068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:26.144239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:26.144517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:26.144789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:26.145533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:26.145835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:26.147297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:26.173343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 236/476] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:26.178821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:26.293792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937be9e2-dc60-420f-828e-569e361d82cf None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:26.312978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:26.337007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:26.338618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:26.339199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:26.339774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:26.340676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:26.342396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:26.379605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 241/477] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:28:26 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:26.452284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:26.600986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8930cba-6a85-48c0-a814-90bc82bf456f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:26.643088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:26.643707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:26.643988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:26.644260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:26.644942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:26.646360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:26.660716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.sql.core [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:28:26.660716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 23:28:26.660716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [parameters: {'id': '06af13ecb0f942fd94f1248293417fe6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 23:28:26.660716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81695) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Aug 29 23:28:26.677234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return ref.to_dict() Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:28:26.678204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application yield resource Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise self.value Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application session.commit() Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:28:26.679790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:28:26.680651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:28:26.681574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application result.read() Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:28:26.682395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [parameters: {'id': '06af13ecb0f942fd94f1248293417fe6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:26.684427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 29 23:28:26.686584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:26.688057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 237/478] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Aug 29 23:28:26 2022] POST /identity/v3/roles => generated 144 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:26.688138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:26.808308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5d321-497e-422e-818a-409c8ff4ecb5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:26.847276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e4189-3553-419b-b4a7-025a30d888b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:26.847914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4189-3553-419b-b4a7-025a30d888b7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:26.848192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4189-3553-419b-b4a7-025a30d888b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:26.848461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e4189-3553-419b-b4a7-025a30d888b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:26.859889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e4189-3553-419b-b4a7-025a30d888b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-076e4189-3553-419b-b4a7-025a30d888b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:26.865981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:26.866880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:26.868130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 242/479] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:28:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:26.873324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:26.920166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:27.021199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6890d-da26-4cec-8e1e-dfd03e3904cc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:27.062173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:27.062863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:27.063148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:27.063530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:27.064294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:27.064592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:27.066067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27d27b-0313-49c8-a3ec-df4d72c2c27b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:27.075333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 238/480] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:28.044747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195a2a-ea4a-49c8-8717-aad30879d1e4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.045270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195a2a-ea4a-49c8-8717-aad30879d1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.045270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08195a2a-ea4a-49c8-8717-aad30879d1e4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.046924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 243/481] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:28.053439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5185824-0a30-4a6b-b6e8-abebe373adb4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.053915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5185824-0a30-4a6b-b6e8-abebe373adb4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.054005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5185824-0a30-4a6b-b6e8-abebe373adb4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.056667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586814-11f1-4673-93cf-783846a7de23 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.056954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586814-11f1-4673-93cf-783846a7de23 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.057226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af586814-11f1-4673-93cf-783846a7de23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.060141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 239/482] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:28.069212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab0d3-820f-4ede-aab8-b8f119d7a54f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.069526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab0d3-820f-4ede-aab8-b8f119d7a54f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.069803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ab0d3-820f-4ede-aab8-b8f119d7a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.081026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-af586814-11f1-4673-93cf-783846a7de23 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:28.082522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-af586814-11f1-4673-93cf-783846a7de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:28.096806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1f0ab0d3-820f-4ede-aab8-b8f119d7a54f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:28.098149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1f0ab0d3-820f-4ede-aab8-b8f119d7a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:28.118291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:28.170513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 244/483] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:28.239951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 240/484] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:28.401882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9983db-323e-4234-a71e-be2445194b5d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.402578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9983db-323e-4234-a71e-be2445194b5d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.403104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9983db-323e-4234-a71e-be2445194b5d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.405086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 245/485] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:28.410902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.411191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.411470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.438312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:28.439493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:28.452612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:28.523578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 241/486] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:28.555823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9983db-323e-4234-a71e-be2445194b5d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:28.598777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:28.723879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9983db-323e-4234-a71e-be2445194b5d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:28.730862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951b4a2-43f5-4b04-abd9-b57266b4361b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:28.776733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:28.777714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.778714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.779744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.801369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:28.802286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:28.803135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.803602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.804040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:28.815343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:28.816532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:28.817535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:28.822141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 242/487] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:28.826776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:28.828624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:28.844041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:28.845215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:28.846864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:28.849715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:28.850181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 246/488] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:28.856092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:28.906966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:28.963141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9593a2-7153-402e-9a3f-2a6fd304f644 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:28.992037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acab9fa-b7de-4ecb-a79c-64253a30a60b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:28.998270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:28.999058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:28.999339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:28.999611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.000289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:29.000595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.002022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.011538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 243/489] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:29.012448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.033738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.034337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.034661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.034876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.035545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:29.035846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.037239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.045892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 247/490] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:29.046706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.113689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.165913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49659865-fd50-4216-8281-c995af01dd80 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.178490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.195125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a099bed-dea0-4670-a02d-ed39df56da0e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.204353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4e1aa-5175-48fb-80d5-31aca21e9e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.204981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e1aa-5175-48fb-80d5-31aca21e9e94 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.205257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e1aa-5175-48fb-80d5-31aca21e9e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.206138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4e1aa-5175-48fb-80d5-31aca21e9e94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.218515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4e1aa-5175-48fb-80d5-31aca21e9e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-27a4e1aa-5175-48fb-80d5-31aca21e9e94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:29.223778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:29.224663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:29.226217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 244/491] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:29.226865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7981e-1085-40cd-91b4-304691c03f5a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.226865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7981e-1085-40cd-91b4-304691c03f5a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.226988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7981e-1085-40cd-91b4-304691c03f5a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.232415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 245/492] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:29.232415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7981e-1085-40cd-91b4-304691c03f5a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.241659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.242358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.242878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.243154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.256554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.258105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:29.273501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:29.274522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:29.275370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:29.275370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:29.275370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:29.279617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 248/493] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:29.280482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.350412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7981e-1085-40cd-91b4-304691c03f5a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.380441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.391146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.391773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.392052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.392322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.396492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d65f23-2b4f-4679-a620-f70d39a9e6cf None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.403709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.405189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8c9e544f-61a6-450d-bc44-e8037fc97c33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:29.420197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:29.421187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:29.422053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:29.422053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:29.422053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:29.422053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 246/494] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:29.422829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.422829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.423057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.442509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:29.443699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:29.446976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.447834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.448315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.448797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.449693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:29.450200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.451909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.458441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.468734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 249/495] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:29.469743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.512976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 247/496] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:29.513748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.585495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658e253-ab30-46d0-8468-846209a4c1dd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.624166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.624862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.625148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.625446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.626346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:29.626541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.627931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.640511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 250/497] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:29.641484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.642604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258950f-ebe8-4a30-8810-491cc9da970c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.654868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.684395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.685509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.685989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.686471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.687369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:29.687887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.689482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.705748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.706852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 248/498] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:29.707819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.748670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795cdfde-2840-4552-a96b-82f2dc8f5023 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.785577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.786130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.786407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.786715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.797825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.799853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:29.815508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:29.816542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:29.817412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:29.817412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:29.817412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:29.817412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 251/499] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:29.818752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.818874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35457669-a9cf-40a8-ac54-ff001c2ab938 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.854001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.854629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.854904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.855171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.863391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.864848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5d80b76f-610b-44f4-9209-7e2b0897ef83 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:29.877592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:29.878568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:29.879472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 249/500] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:29.880048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6e65-63ce-441f-8ae3-27fe0888dae7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.880287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6e65-63ce-441f-8ae3-27fe0888dae7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.880566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d6e65-63ce-441f-8ae3-27fe0888dae7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.881848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 250/501] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:29.882555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d6e65-63ce-441f-8ae3-27fe0888dae7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.914422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.926952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6305df-c701-4f37-92da-be96f1a83e57 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:29.939737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:29.962196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:29.963080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:29.963361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:29.963633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:29.971761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:29.973306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:29.985879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:29.986777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:29.987670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 252/502] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:29.988375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:29.993061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d6e65-63ce-441f-8ae3-27fe0888dae7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.029268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.029922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.030202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.030473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.041522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:30.046704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:30.047662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:30.048459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 251/503] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:30.049131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.095774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfa4c1-14a6-4786-93d7-8cedb43cf12c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.135142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.135753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.136025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.136296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.136936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:30.137236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.138657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39a9d9-6531-49ed-a9a1-e83d792d01cf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.144419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.152646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 253/504] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:30.154017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.154321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.154583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.160995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49b968-6f9c-4552-9ae0-2c9285f79344 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.172787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:30.174035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:30.195224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.195828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.196103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.196369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.197090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:30.197414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.198859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.199747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.240220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 252/505] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:30.241296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.242365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 254/506] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:30.243192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.343208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba1c56-65be-43cd-bd03-16de430d6a7e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.344836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb61d575-10c4-4aa0-a65d-812f9aa7d4a1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.380989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.381904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.382255 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.382535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.383298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:30.383603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.383736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.384479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.384823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.384981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.385208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.386023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:30.386389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.387884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.394931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 255/507] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:30.395650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.415748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 253/508] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:30.415748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.416612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.429999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.513822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fa136-738e-4f57-98bd-c8ec749def70 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.533114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce54c959-d3cc-4e74-9758-5af7904af38d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.548079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.548702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.548982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.549254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.556695 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.558168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.567185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.567786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.568061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.568330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:30.569571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:30.570582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:30.571489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 256/509] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:30.572069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.639491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.640964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.644563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.660524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.677817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3889af-7dca-43b9-8947-c3d1c7861d64 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.711738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.712604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.712879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.713147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.723999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.725525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:30.740776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:30.742583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:30.744276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:30.744276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:30.744276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:30.746938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 257/510] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:30.747956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.750997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 254/511] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:30.751842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.876863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26790f2-05f1-41e7-a3b3-77c73c5ce593 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.879761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.880684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1234195-9454-4abe-91d7-6d294836043f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:30.913454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.913742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:30.914005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.914285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.914379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:30.914560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.914652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:30.914874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:30.918288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:30.925217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.926695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:30.941569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:30.942710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:30.943770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:30.943770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:30.943770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:30.943770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 255/512] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:30.943770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:30.987319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:30.988793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.046182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183a79a-843b-4bd3-933d-2ba18532877b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.081144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.081789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.082065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.082333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.083055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:31.083356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.084799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.103622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 256/513] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:31.104459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.123753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.150940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 258/514] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:31.151304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.195991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.233105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4da2e-6fb9-4e10-847e-647578692c8d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.274141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.274746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.275020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.275287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.276411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:31.276411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.277366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70509244-3cdd-4aa0-bfbc-fb342ace70a1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.277854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.289977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 257/515] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:31.290824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.321673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.321949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.322220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.322486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.333005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.334506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:31.350098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:31.351098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:31.351954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:31.351954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:31.351954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:31.351954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 259/516] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:31.352183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.379927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.416521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea1db9-8c80-4150-bfea-5046a4967639 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.450787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.451065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.451677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.451956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.452225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.452861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:31.453159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.454679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.464825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641dc0e1-74c1-446f-8f15-57d27c145a2f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.467318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 258/517] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:31.468136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.499225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.499826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.500101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.500402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.571081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.572055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53721a02-a65b-4ba0-a846-844d127ff977 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.572563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.607147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.607772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.608044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.608318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.610260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.619830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.621288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:31.635693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:31.636833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:31.637724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:31.637724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:31.637724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:31.637724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 259/518] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:31.637987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.664966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.678415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 260/519] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:31.679336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.745669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4125b-d0ea-47ef-b241-499f16fb8f16 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.780207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.780825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.781099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.781389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.789606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.791060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.791866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a673cb9-5f53-480e-ad22-6cf71aad8696 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:31.802233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:31.803434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:31.804316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 260/520] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:31.804879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.828455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.829056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.829332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.829630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.830270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:31.831064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.832452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.843878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 261/521] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:31.844761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.856073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.895551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:31.911722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa56b-a4d3-4f64-9eae-5736dcb0c0ef None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.945497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.946094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.946372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.946639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.946729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e904-d652-4ab1-b8b6-a9c4fd903eeb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:31.947282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.948705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.970463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 261/522] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:28:31 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:31.971312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:31.982219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:31.982846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:31.983123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:31.983392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:31.984057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:31.984360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:31.985819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:31.999584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 262/523] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:32.000369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.103952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b13d-afbc-453a-afd4-52403e2296e9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.105623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.118474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01731863-e140-4167-a1d4-3eb6d3358511 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.129809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.153522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.153879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.154170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.154442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.169511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.170065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.170822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.171103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.171302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.171399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.172099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:32.172404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.173905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:32.186297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:32.187293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:32.188146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:32.188146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:32.188146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:32.188146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 262/524] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:32.188897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.221878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 263/525] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Aug 29 23:28:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:32.223685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.291969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28a24-b0de-4f73-b7c6-c99933e68363 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.327316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.327940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.328214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.328481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.335506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.336941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.349005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83455-8ea4-4c1c-843c-1d5220684b93 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:32.350230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:32.351110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:32.351944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 263/526] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:32.352429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.369626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.392956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.393614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.393894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.394168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.402237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.403716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:32.418487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:32.419392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:32.420418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:32.420829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 264/527] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:32.421573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.450059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.471304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98e95-6462-427f-b708-4a753a5dfb91 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.509204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.509937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.510218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.510549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.511342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:32.511883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.513162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.533142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 264/528] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:32.533326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f181-ccd4-4324-abe5-14b6588c4d30 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.533459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.571128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.571648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.571922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.572186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.615334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.644024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800384f7-bd2a-4fd1-8454-ee109e7e290a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.649696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.651185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.681343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.687859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.688465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.688743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.689013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.689765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:32.690792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.691504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.709418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 265/529] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:32.710098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.769871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 265/530] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:32.770953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.819955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590dc2-f0db-4e5a-8f3c-231bd1700885 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.856253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.856779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.857057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.857329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.858052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:32.858364 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.859915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.862227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.873335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 266/531] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:32.874030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.885112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5cfdb5-1452-46fa-bc73-533e54ea1ccb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:32.912849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:32.924026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:32.925923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:32.926792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:32.927265 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:32.936560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:32.938514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:32.954956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:32.956378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:32.957214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:32.961494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 266/532] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:32.962626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:32.987702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc55135-13eb-4859-b5cf-0b675c9b184a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.022492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.023204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.023486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.023758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.024587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=2b8d3f2d7323411d81303f472a16d562) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:33.024895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.026488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.041618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 267/533] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/role_assignments?user.id=2b8d3f2d7323411d81303f472a16d562&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:33.041618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:33.095883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552bc3-7292-4424-9834-c32f4a2aa328 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.136370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:33.139885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.143873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.143873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.143873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.163468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.166295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:33.186602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:33.188170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:33.189173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:33.189173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:33.189173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:33.190967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 267/534] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:33.192084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:33.214803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3964-ce79-47ce-aebb-9723e00b04d9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.238422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:33.259468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.259943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.260223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.260494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.261232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=09019a1191eb4b4194c245dff90ef942) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:33.261650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.263230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.277381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 268/535] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/role_assignments?user.id=09019a1191eb4b4194c245dff90ef942&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:33.277381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:33.368401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc7605-4754-44e0-8204-ba00ce978363 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.414320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c68e6f-05ab-414e-a83d-4d7809def5c5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.442962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:33.458763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.460046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.460529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.461025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.462081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:33.462843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.464548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.474050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.474694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.474955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.475210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.475912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:33.476214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.482562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.488428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 269/536] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:33.492831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:33.512997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 268/537] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:33.519564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:33.621557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872f83-807f-4850-ad1f-de3abc78a73a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.670909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.671887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.672430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.672899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.684853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.686733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.701313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbdb67-3719-46be-b34c-3b21c05f547b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.709795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:33.714454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:33.718189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:33.719074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 270/538] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:33.721783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:33.742003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.742605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.742875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.743134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.743909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=e0b4196792fe44f2a8fb31bba5a6006e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:33.744211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.745981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.758015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 269/539] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/role_assignments?user.id=e0b4196792fe44f2a8fb31bba5a6006e&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:33.803115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:33.879746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd20ab6-5cb9-48e9-a1aa-90eb17e9a5c2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:33.938298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:33.938856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:33.939135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:33.939406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:33.940759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:33.941060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:33.942552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042cfa4-3ee0-4b3a-8dae-da00de2abd7d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:33.955987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 271/540] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:33.962531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:34.003936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267dad1-2466-4bd2-abd7-a7d231904e21 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:34.004226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267dad1-2466-4bd2-abd7-a7d231904e21 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:34.004500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267dad1-2466-4bd2-abd7-a7d231904e21 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:34.007144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 272/541] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:28:34.017374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:34.017374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:34.017374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:34.030911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:34.032117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:34.129289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e5d3-fdc7-428c-a6e8-3a79d111b230 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:34.141116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 273/542] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:34.195111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:34.195621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:34.195902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:34.196169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:34.196958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=573e64b25ae04a47aa757ba787fc850e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:34.197269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:34.198796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:34.209518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 270/543] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:33 2022] GET /identity/v3/role_assignments?user.id=573e64b25ae04a47aa757ba787fc850e&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:34.516266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:34.547877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:34.628071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928199e6-2102-49d5-adbe-df0572e562f9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:34.669714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:34.670352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:34.670632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:34.670904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:34.688341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:34.695879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:34.696760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:34.697570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:34.698165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 274/544] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:34.704117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:34.740946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:34.841201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612f85e-d7c9-4b89-83e7-61c7aa7d326b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:34.886089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:34.886728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:34.887063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:34.887341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:34.888046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:34.888321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:34.889870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:34.899128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 271/545] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:34.904673 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:35.015080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:35.025391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ba70e-6862-468e-bce9-95a8b1e4e6c1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:35.061216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:35.061880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.062159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.062431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.073457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:35.074944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:35.090675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:35.091656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:35.092492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:35.092492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:35.092492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:35.092492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 275/546] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:35.098103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:35.208432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:35.226589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdd629-9ad4-49e4-9794-2667f7c8a63c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:35.269925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:35.270546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.270827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.271100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.271762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:35.272065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:35.273553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a09f10-0980-47ae-b81d-bac9a0ab3b75 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:35.290884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 272/547] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:35.296718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:35.425797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c081d966-f5d1-4c2e-8e8d-8d36955fa707 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:35.430492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8b59b-ce32-42db-8363-f7a6097229bc None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.431020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8b59b-ce32-42db-8363-f7a6097229bc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.431654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8b59b-ce32-42db-8363-f7a6097229bc None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.433555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 273/548] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:35.438701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.439214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.439761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.459853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:35.461411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:35.493376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:35.493376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.493376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.493376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.503803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:35.505253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:35.528870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:35.530759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:35.531826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 276/549] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:35.537435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:35.545639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:35.570334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 274/550] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:35.662092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07037647-6127-4727-9e79-550163c3e7b7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:35.710617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:35.711208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.711528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.711806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.712844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:35.713153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:35.714601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eb6c56-b98f-4f09-a494-03d530ccf8dc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:35.739220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 277/551] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Aug 29 23:28:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:35.744796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:35.832330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:35.864802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b1440-e470-4a60-af17-eae762bf936e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:35.891715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba81c57-b8a7-407e-a4c3-be0f972f1dc7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.892115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba81c57-b8a7-407e-a4c3-be0f972f1dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.892307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba81c57-b8a7-407e-a4c3-be0f972f1dc7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.894307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 278/552] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:28:35.905478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.905781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.906054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.908903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:35.909574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:35.909858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:35.910130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:35.935354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:35.936564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:35.989071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:35.990923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.042823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.056747 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 279/553] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:36.058085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.106798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.163228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 275/554] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:36.170436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.211974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa45fd-4ff0-44bd-b02b-0fc0cb15176f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.254589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.255148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.255430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.255706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.268016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:36.273927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:36.274882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:36.275676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 280/555] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:36.286470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.330949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818389a8-70da-478c-b8fd-a73b1384cbb6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.371056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.372027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.372524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.373157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.384457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:36.386261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.391766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f5a7df03-2ce5-4f00-af44-f1e6a63bad58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:36.402988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:36.404173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:36.405035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:36.405035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:36.405035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:36.407378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 276/556] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:36.409793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c331-a977-4294-a9a0-2c24c91d0fd3 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.410260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c331-a977-4294-a9a0-2c24c91d0fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.410726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c331-a977-4294-a9a0-2c24c91d0fd3 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.412435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 277/557] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:36.413873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c331-a977-4294-a9a0-2c24c91d0fd3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.453929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.459813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30821e7d-9aa8-48b5-a014-902758bfa9bf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.499822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.501174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.501174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.501174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.501674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:36.501978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:36.503406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfb9f6-4806-4799-ae74-820273ff1d0d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.516459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 281/558] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:36.516459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.516459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.516459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.532594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:36.534426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:36.538685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c331-a977-4294-a9a0-2c24c91d0fd3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.574745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.575351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.575822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.575976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.576511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:36.576811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:36.578322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.596373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 278/559] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:36.596373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.617312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 282/560] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:36.618279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.671986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.711486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.722768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505e882-49b5-4eb0-a56f-85bf3e83d485 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.737796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65a21d-13d2-4319-b34c-23ca30eed41d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.759443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.760325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.760752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.761155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.772962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:36.774986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.775612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.775929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.776197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:36.779139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:36.780073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:36.780946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:36.785495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 279/561] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:36.786362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.790786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:36.792249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8a144dd4-b206-479d-a204-fe98351e2761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:36.807680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:36.808650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:36.809567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:36.809567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:36.809567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:36.809567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 283/562] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:36.810095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cdf9a-50bd-45eb-913d-156ed1e80935 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.810224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cdf9a-50bd-45eb-913d-156ed1e80935 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.810495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cdf9a-50bd-45eb-913d-156ed1e80935 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.815647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 284/563] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:36.815647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cdf9a-50bd-45eb-913d-156ed1e80935 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.901502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b6f0f-fc68-46d2-b908-30c00e6bd157 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.918074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.925900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cdf9a-50bd-45eb-913d-156ed1e80935 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:36.936158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.936772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.937046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.937312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.944233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:36.945716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:36.957173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:36.958208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 280/564] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:36.959138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:36.961919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:36.963598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.963884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.964159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.964831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:36.965133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:36.966530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5b25a-6e9f-490d-98a5-2ec26be4db7c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:36.972009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:36.980727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 285/565] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:36.980727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:36.980727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:36.980727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:36.995562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:36.996818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:37.060023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a45873-fb7f-4b45-8632-a303bae0cffa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.062963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 286/566] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:37.063790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.096711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.097330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.097624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.097890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.098532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:37.098826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.100215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 281/567] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:37.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.179017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.190270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.196063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d41275-783c-4082-a28d-5f214a3d89cd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.223231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc4ad9-8330-4e7a-ad2e-95083a090d3c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.233982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.234624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.234905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.235175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.246416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:37.251192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:37.252633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 287/568] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:37.253917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.264654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.265263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.265572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.265846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.266538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:37.266843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.268836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.282019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 282/569] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:37.287566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.361989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1cf7c-697b-4f7e-9d08-353a1f616e1e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.394995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b4fa-caf2-41ff-a57d-378f60a110a9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.396873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.397547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.397832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.398103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.409225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.410830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.419277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.424555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:37.426376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:37.427600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:37.428685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:37.428685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:37.428685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:37.430281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 288/570] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:37.431363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.431859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.432485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.432766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.433039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.442126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.443566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:37.454726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:37.456370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 283/571] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:37.458085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.537751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d79e96-3bf8-45ff-814f-802dca94c0c0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.557227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d507db8d-4514-4ac1-a9fe-ab2f8c139696 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.571306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.571900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.572172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.572437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.573093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:37.573427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.574773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.582612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 289/572] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:37.583498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.592232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.593051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.593327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.593627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.594346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=8c13a2711f2f4a0dbbc312b7a1b9034b) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:37.594651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.596071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.601512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 284/573] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/role_assignments?user.id=8c13a2711f2f4a0dbbc312b7a1b9034b&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:37.602280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.667634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.670080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.719072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2bf1-e5a8-4487-860a-363156150a59 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.722378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8006214-2fd7-41e9-aaf6-6799aa47ba88 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.759611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.760236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.760509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.760777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.765655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.766266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.766783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.766973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.767682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:37.767993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.769452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.772252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:37.777631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:37.778667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:37.779676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:37.785387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 290/574] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:37.785536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 285/575] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:37.785536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.787064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.893964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77786700-e680-46b5-9799-d7dc36cceba2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.897306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391651d-e634-40a8-a080-6b99ad8037bb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:37.913906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.925655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:37.936887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.937523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.937887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.938165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.938890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:37.939234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.940665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.940766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:37.941367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:37.941653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:37.941922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:37.953546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:37.954985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:37.959495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 286/576] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:37.960502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:37.970596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:37.972084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:37.972990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:37.972990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:37.972990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:37.976889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 291/577] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:37.977624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.073094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbc404-293c-4706-b902-c08c30ddc6ef None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.086423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c8742-bf2f-4343-a366-2f3e405286d2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.114860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.115809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.116093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.116365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.122207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.123069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.123069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.123408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.123985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:38.124288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.125197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.125686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.127242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.134101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 292/578] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:38.134924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:38.144441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:38.145653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:38.146605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:38.147856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 287/579] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:28:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:38.149764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.181790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.184569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.254340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12c2e0-41da-4133-a57e-0e6213e52469 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.273909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41307bd-2fdf-4702-b899-6bb155c878d2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.296761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.297585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.297715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.297961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.318163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.320899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.320899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.320899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.320899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:38.320899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.321457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.322380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.324476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.338514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 288/580] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:38.338514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:38.347935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:38.348921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:38.354767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:38.354767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:38.354767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:38.354767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 293/581] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:38.354767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.440188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.449554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a197d-c865-437b-9d78-fee4138674f6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.454078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.470144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41300e2-85a4-455a-9d59-8602134c9b58 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.486709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.487327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.487601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.487870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.498336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.499770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.507407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.508020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.508477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.508935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.510352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:38.510898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.513531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:38.514732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:38.515948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:38.517325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:38.517325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:38.517325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:38.520894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 289/582] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:38.521684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.536070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 294/583] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:38.537184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.635066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ced512-d380-4635-8d10-4a2335cafd8c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.643577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247e83f-ba7f-464a-8bb3-cb0c87a3fc4b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.679988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.680641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.680921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.681039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.681257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.681669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.681949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.682216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.682877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:38.683178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.684598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.691187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.692744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.703066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 295/584] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:38.703066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:38.705890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:38.707013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 290/585] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:38.708150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.717167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.721742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.823375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b363f2-83de-43d7-8bad-ac9052470c31 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.823587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d114f4-4745-4dad-a4a2-7fc71ffc1d1d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:38.858773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.859487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.859839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.860181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.862519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:38.863194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:38.863473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:38.863745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:38.864382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:38.864682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.866122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.871666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:38.873173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:38.884077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 296/586] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:38.884077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:38.896323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:38.897884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:38.898932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:38.898932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:38.898932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:38.898932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 291/587] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:38.898932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:38.958359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.964241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:38.996968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fcedf-b837-44e5-b6ad-9bf8cde32f63 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.013877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd484-d994-44b3-8b37-547ced6bd86c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.033420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.034221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.034603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.034968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.042227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.043773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.049660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.050261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.050540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.050810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.051531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:39.051831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.053247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:39.056615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:39.057795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:39.059003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:39.063729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 297/588] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:39.064486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.072557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 292/589] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Aug 29 23:28:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:39.073193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.185303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c7e1c-6eeb-4e91-b909-9edcc8c8de86 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.194139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86823d7-0df7-4a7b-a859-46f36e8bf342 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.210849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:39.215494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:39.224498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.225124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.225436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.225708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.233859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.234774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.235376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.235479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.235659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.235930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.237102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:39.237415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.238993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:39.247627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:39.248801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:39.249771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 298/590] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:39.250364 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.258765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 293/591] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:39.260518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.382652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3758f-c96f-4899-a82b-7b8e91c2c3e1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.385012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53eae0-53dd-4e48-9b90-1cddb0b46368 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.421531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.422232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.422577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.422966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.423679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:39.424079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.425134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.425692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.425936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.426281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.426620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.438908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.439962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 299/592] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:39.441211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.445811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:39.461960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:39.463172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:39.464086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:39.464086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:39.464086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:39.468196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 294/593] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:39.468925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.492360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:39.499028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:39.550844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023981e-89c1-4477-85e3-71c323851931 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.573570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebb42-dfcf-4859-8406-5e13b6eca8a1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.586006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.586710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.586866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.587137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.588118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:39.588416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.589888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.610814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 300/594] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:39.618108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.618251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.618251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.618251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.618251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.625155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.626690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:39.639251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:39.640337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 295/595] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:39.641400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.719154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b59890c-093e-406c-95e2-0828ef820f17 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.721393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:39.726897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:39.743498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a94b-3f68-4a88-a287-bb4e2b3bb287 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.753694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e5e46f-755d-4997-b83a-00fc0e4b51db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.754341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5e46f-755d-4997-b83a-00fc0e4b51db None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.754613 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5e46f-755d-4997-b83a-00fc0e4b51db None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.754877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e5e46f-755d-4997-b83a-00fc0e4b51db None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/2b8d3f2d7323411d81303f472a16d562/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.768950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5e46f-755d-4997-b83a-00fc0e4b51db None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=2b8d3f2d7323411d81303f472a16d562, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.770428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e5e46f-755d-4997-b83a-00fc0e4b51db None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.778249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.778964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.779249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.779524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.780171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:39.780475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.781864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.783136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 301/596] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:28:39 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/2b8d3f2d7323411d81303f472a16d562/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:39.784511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c53a5-106d-4a1a-bdc6-c6ff9a60b4b0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.784797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c53a5-106d-4a1a-bdc6-c6ff9a60b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.785065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c53a5-106d-4a1a-bdc6-c6ff9a60b4b0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.789459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 302/597] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:39.789459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c53a5-106d-4a1a-bdc6-c6ff9a60b4b0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.797732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 296/598] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:39.798755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:39.913305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c53a5-106d-4a1a-bdc6-c6ff9a60b4b0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.928782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f695f3-c06e-49d3-85f4-7018a1d6b5b9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:39.955864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.956605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.956947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.957283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.968507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.968696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:39.969437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.969713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.970071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.970352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.970941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:39.971310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:39.972785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a1512-4423-4efe-b54f-45c6cd9eafb0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:39.984710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 297/599] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:39.986909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:39.987220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:39.987538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:39.991067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:39.992254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:39.993374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:39.993374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:39.993374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:39.993717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 303/600] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:39.994538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.005914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.007728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.014482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:40.015790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:40.092845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 298/601] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:40.094037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.105022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1fcd2-e21c-4570-b54b-3332d4dcb086 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.147874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.147874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.147874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.147874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.163606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.165613 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:40.181058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:40.182184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:40.183176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:40.189612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 304/602] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:40.190680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.232527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683bdbb-6076-4a60-8a45-58fb945ad9bd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.265752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.279552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.280371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.280652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.280923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/09019a1191eb4b4194c245dff90ef942/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.288164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.304598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=09019a1191eb4b4194c245dff90ef942, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.305950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.308137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47b6219-f4a5-416f-8663-bea46b040a24 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.320556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 299/603] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:28:40 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/09019a1191eb4b4194c245dff90ef942/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:40.321663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.349730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.350786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.351296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.351777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.352663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:40.353270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.355073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.375108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 305/604] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:40.376894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.454462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05948-5616-4f65-9060-27f78ebe8b98 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.494050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cbeb7-6869-4137-8ff2-fdbb974a6af5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.494493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.495116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.495449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.495719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.496471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:40.496775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.499183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.511589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 300/605] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:40.512374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.528936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.541644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.542283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.542560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.542827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.550430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.552125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:40.564965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:40.565924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 306/606] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:40.567174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.573286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.638867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2777a5a-5955-4af7-934a-a514133342e4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.679760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2085-2775-4433-8590-61201806f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.680554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2085-2775-4433-8590-61201806f3de None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.680836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2085-2775-4433-8590-61201806f3de None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.681107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c2085-2775-4433-8590-61201806f3de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.692774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c2085-2775-4433-8590-61201806f3de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-336c2085-2775-4433-8590-61201806f3de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:40.698390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:40.699327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 301/607] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:40.700781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2085-2775-4433-8590-61201806f3de None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.707382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d48ff19-7982-4733-b509-bbd024040072 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.746835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.747459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.747727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.748005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/e0b4196792fe44f2a8fb31bba5a6006e/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.773644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=e0b4196792fe44f2a8fb31bba5a6006e, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.775978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.801397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 307/608] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:28:40 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/e0b4196792fe44f2a8fb31bba5a6006e/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:40.801397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.847142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.891700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c2085-2775-4433-8590-61201806f3de None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:40.900639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:40.942497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:40.943116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:40.943392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:40.943659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:40.944358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:40.944661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:40.946141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:40.962540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 302/609] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:40.969847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:40.998523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ad61c-3715-45b2-84c4-6954bc42f413 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:41.043532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:41.044335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.044744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.045111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.046138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:41.046320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:41.047812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:41.057786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 308/610] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:41.065371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:41.111618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622aa369-1404-4c05-b76d-9fa743553de4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:41.158062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:41.158767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.159046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.159316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/573e64b25ae04a47aa757ba787fc850e/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.178161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=573e64b25ae04a47aa757ba787fc850e, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:41.179819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:41.205907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 303/611] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:28:40 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/573e64b25ae04a47aa757ba787fc850e/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:41.217246 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:41.221828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957c505-138b-4d56-8aeb-7e3dd5e3e6bc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:41.282928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:41.283670 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.284068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.284370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.301852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:41.303351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:41.323985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:41.324998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:41.326346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:41.326346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:41.326346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:41.326346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 309/612] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:41.334522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:41.367244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:41.459617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a8780-6b98-4faa-bb56-631470b82bb4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:41.498589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:41.499497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.499986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.500454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.501273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:41.501827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:41.503950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:41.517456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 304/613] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:41.525498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:41.681159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b54590-36db-46e5-8914-55c4ab222cc2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:41.726217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:41.726855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.727134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.727404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.746633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:41.748113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d91e2d65-3458-4b91-b233-761ede3a7fd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:41.762837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:41.763839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:41.765542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 310/614] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:41.769597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:41.857665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce00a9-4f9e-478b-b892-2b62029e0acc None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.857994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce00a9-4f9e-478b-b892-2b62029e0acc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.858220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce00a9-4f9e-478b-b892-2b62029e0acc None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.859813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 311/615] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:41.865448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:41.865732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:41.866001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:41.899609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:41.900859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:41.908938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:41.924576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:41.987255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 312/616] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:41.991235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5d725-b859-462f-b08f-58a07c24cc11 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:42.030023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:42.030627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.030901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.031169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.031890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:42.032186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:42.034201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:42.060989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 305/617] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Aug 29 23:28:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:42.066172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.201547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f0d26-0eec-4384-b556-2577b4863038 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:42.243551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:42.244126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.244401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.244667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.256766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:42.257300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:42.262190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:42.281004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:42.282264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:42.283784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:42.283784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:42.283784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:42.286504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 313/618] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:42.292067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.297330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.467130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d77667-7746-4dcd-9403-cf8245f05445 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:42.490187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07a209-df3f-4fad-b7f0-5122ab65899b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:42.537520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:42.538041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.538318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.538586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.539220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:42.539517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:42.540886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:42.542520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:42.542635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:42.543262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.543549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.543821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.554809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 306/619] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:42.559332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.573331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:42.579163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:42.580643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:42.581536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:42.584223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 314/620] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:42.591087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.711427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:42.717264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e4374-399a-4ed1-9cc5-5e852b65bf7a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:42.791292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:42.792266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.792753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.793228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.805168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:42.807539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:42.810120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746d382-c7b0-401c-81d5-45d79301a8a7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:42.830741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:42.831734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:42.832617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:42.839344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 307/621] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:42.843770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.884486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:42.885543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.886031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.886505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.887400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:42.887907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:42.889545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74c6bc-f29a-4412-a86f-f4434f355379 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:42.903959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 315/622] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:42.906621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5c18-3ae7-4952-833c-1d8a4fd965a0 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:42.907819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5c18-3ae7-4952-833c-1d8a4fd965a0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:42.908929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad5c18-3ae7-4952-833c-1d8a4fd965a0 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:42.910703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 316/623] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:42.913799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad5c18-3ae7-4952-833c-1d8a4fd965a0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:42.944380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.005720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea5a41-4d8e-4d81-9d32-0b0adda46846 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.038047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad5c18-3ae7-4952-833c-1d8a4fd965a0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.048117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.048666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.049987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.050270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.050966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:43.051269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.053451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ffa01-0a90-4842-9e8e-bdd978dc3b8c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.056562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.072917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 308/624] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:43.074618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.074909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.075182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.082826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.084040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.084537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.085075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.099796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:43.100626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.101129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:43.102605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:43.119626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:43.120643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:43.121573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:43.121573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:43.121573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:43.123722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 317/625] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:43.124740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.187321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 309/626] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:43.188066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.258416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.268993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057240b2-7fd5-43a6-99b7-9ed19666fc9c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.307630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da114c1-1730-40ed-bb52-fba2b9f51162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.308673 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da114c1-1730-40ed-bb52-fba2b9f51162 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.309182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da114c1-1730-40ed-bb52-fba2b9f51162 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.309680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da114c1-1730-40ed-bb52-fba2b9f51162 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/8c13a2711f2f4a0dbbc312b7a1b9034b/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.325898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da114c1-1730-40ed-bb52-fba2b9f51162 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=8c13a2711f2f4a0dbbc312b7a1b9034b, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.327667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da114c1-1730-40ed-bb52-fba2b9f51162 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.330830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013b31a-a62a-4134-bde4-62d647397967 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.345177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 318/627] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:28:43 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/8c13a2711f2f4a0dbbc312b7a1b9034b/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:28:43.347732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ebe1-79d1-4891-82ca-f368e6c12f72 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.348184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ebe1-79d1-4891-82ca-f368e6c12f72 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.348717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ebe1-79d1-4891-82ca-f368e6c12f72 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.351160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 319/628] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:43.357104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.357428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.357679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.384361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.385450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.385978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.386452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.387464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:43.387971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.389679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.402552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:43.403753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:43.404490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 310/629] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:43.411739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.427074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.521488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 320/630] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:43.522504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.566482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb57ea-404f-402a-9db9-cb2c96ef389e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.568882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.607261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.607924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.608205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.608481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.617953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.619493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:43.632270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:43.633260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:43.634249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 311/631] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:43.639055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.650013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f3800-f020-473a-8ca4-92d22f96d3ba None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.705627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eec984-5dbe-47a7-86ba-9a3e12f230dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.706667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eec984-5dbe-47a7-86ba-9a3e12f230dc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.707159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eec984-5dbe-47a7-86ba-9a3e12f230dc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.707630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eec984-5dbe-47a7-86ba-9a3e12f230dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.719204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eec984-5dbe-47a7-86ba-9a3e12f230dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-34eec984-5dbe-47a7-86ba-9a3e12f230dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:43.725262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:43.726220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:43.727055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:43.729683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 321/632] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:43.731181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5b286-ffeb-4cf0-8344-683ffef6d856 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.731678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5b286-ffeb-4cf0-8344-683ffef6d856 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.732195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5b286-ffeb-4cf0-8344-683ffef6d856 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.733909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 322/633] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:43.738776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5b286-ffeb-4cf0-8344-683ffef6d856 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.749797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.755967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fc77c-e2f9-4805-baca-06cc8fe84f38 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.792795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.793553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.793829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.794097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.794816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:43.795115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.796539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b197-316f-4129-8935-2cc8a5ab2a35 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.814576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 312/634] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:43.815806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.816087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.816359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.834828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:43.835905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:43.855496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:43.860574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5b286-ffeb-4cf0-8344-683ffef6d856 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:43.898893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:43.899440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:43.899717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:43.900027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:43.900895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:43.901004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:43.902358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:43.917382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 313/635] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:43.917382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:43.917623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 323/636] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:43.917623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.025321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e33a1-1709-4e4c-ae3c-ea389e8479d7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.054118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.059338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580b74a-84f7-4151-8b83-2a9731d73197 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.070883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.071516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.071791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.072059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.083406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:44.088741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:44.089726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 314/637] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:44.090578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.106548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.107810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.108015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.108443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.108870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.200911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.202572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.221873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4958ff-79e8-43b4-8e36-1ce7e6979f0e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.264380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.265282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.265731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.266224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.271099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.279565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.281444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:44.296762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:44.297917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:44.299535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:44.299535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:44.299535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:44.301278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 315/638] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:44.302330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.310146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 324/639] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:44.311239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.390843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.429481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefca69-cb93-4e54-aa52-4ae7d4d84fb3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.435808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610cc83-787a-478f-af6e-5ca4fab16762 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.468265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.468894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.469265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.469664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.470798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.471406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.471678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.471947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.472629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:44.472925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.474313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.481560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:44.482225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 316/640] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:44.483009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:44.488253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:44.489171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:44.490127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:44.496950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 325/641] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:44.498056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.529907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.594549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8b4af-fd11-4738-bc89-32c9046b7bbf None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.607461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00be8-14ab-4a04-8717-1037608276f4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.623386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.632866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.633523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.633804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.634073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.634724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:44.635031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.636452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.648255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.648896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.649173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.649472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.655312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 317/642] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:44.655312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.666936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.668386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:44.685009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:44.687042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:44.688934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:44.688934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:44.688934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:44.688934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 326/643] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:44.688934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.774421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb273111-2c77-4365-9cbd-f29b228ef14c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.785414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.810039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645d099-d8f8-43d5-8549-0e3afd955830 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.816878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.817547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.817825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.818096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.828973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.830505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.846266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:44.846863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:44.846986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:44.847932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:44.849503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:44.849503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:44.849503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:44.849716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:44.849716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:44.849716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:44.849716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:44.849716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:44.852850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 318/644] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:44.853721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.864078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 327/645] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:44.864078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:44.901850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:44.970230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da2141-2b5e-4416-99c8-09d9cde3cfeb None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:44.971195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997d9ee-2330-47f2-be4c-e24b2adae89a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.006715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.007329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.007615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.007887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.008499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.008635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:45.008815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.009127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.009441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.009719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.010210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.019184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.020862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:45.032783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:45.034535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:45.035638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:45.044078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 319/646] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:45.044078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.044376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 328/647] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:45.044376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.044892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.152357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414b400-93e2-4a0d-9109-96408c757909 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.174058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.179307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc0852-d6c3-4705-8eea-9832a2b33001 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.189626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.190271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.190547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.190820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.201599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.203050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.218892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.219592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.219933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.220269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:45.220401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:45.222047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:45.224400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:45.224400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:45.224400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:45.224571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:45.224571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.224703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 329/648] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:45.224991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.229561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.242160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 320/649] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:45.243065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.290133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.340202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e9a99-2d17-455e-8b81-34b10eb1c189 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.349231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fca14-d13c-4aa4-a83b-34a250e9d93c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.389615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.390585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.391072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.391626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.393919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:45.394461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.394664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.395297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.395582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.395857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.397599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.404270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.407882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:45.421397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:45.427499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 330/650] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:45.428392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.428998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 321/651] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:45.428998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.448511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.536096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba3c17-d051-4522-94df-a058d0f1cbda None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.540482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb230d2-6527-4093-bf3f-424457058c0f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.550550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.571031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.571632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.571935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.572208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.572876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:45.573180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.574592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.574771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.575392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.575671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.575951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.583582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.585004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.586970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 331/652] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:45.588027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:45.601592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:45.603162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 322/653] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:45.604311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.685746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.695234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f01857a-1f7a-43bd-b2c7-287af2d079b2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.710957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468eecc-624a-44d2-a817-4ee0e3fa33c9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.730529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.731134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.731408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.731674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.745239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.745856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.746131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.746398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.747079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:45.747378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.748801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb5e1b-7061-42ef-a4ea-3d099bcd52e4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.761191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 323/654] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:45.762465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251136d-1fdc-43e5-b8a0-95cd16abf6a9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.762743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251136d-1fdc-43e5-b8a0-95cd16abf6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.763010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251136d-1fdc-43e5-b8a0-95cd16abf6a9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.764201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 324/655] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:45.764880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251136d-1fdc-43e5-b8a0-95cd16abf6a9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.783507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.810408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.812109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.869961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251136d-1fdc-43e5-b8a0-95cd16abf6a9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:45.905687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:45.906320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:45.906602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:45.906874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:45.909588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:45.913906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 332/656] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:45.914584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.919389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:45.920875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:45.933286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:45.934264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 325/657] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:45.935215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:45.992702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.018878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eda83d-7f01-4569-8f45-b2b88be2c4d6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.035718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a70e8f-a970-4e74-9653-04b25ccf3bf6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.053138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.053775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.054057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.054326 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.055050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:46.055352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.056784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2119bc-df9c-4e04-b614-5322521b27d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.070581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.071179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.071460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.071730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.072449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=2b8d3f2d7323411d81303f472a16d562) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:46.072762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.074461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.074577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 333/658] 10.222.0.67 () {56 vars in 1139 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:46.075603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.075902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.076175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.080593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 326/659] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:45 2022] GET /identity/v3/role_assignments?user.id=2b8d3f2d7323411d81303f472a16d562&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:46.081259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.103582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:46.104805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:46.155447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.191489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 334/660] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:46.192678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.211213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9726e62-7edf-4f47-afe5-a71fd386d307 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.259086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.259979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.260425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.260702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.274427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.275912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.284055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:46.295299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:46.296266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:46.297178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:46.297178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:46.297178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:46.298418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 327/661] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:46.300750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.346843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215a69e-3e11-47c1-81a4-ca796244ee93 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.393726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.394360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.394634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.395473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.396214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:46.396516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.398450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.423033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 335/662] 10.222.0.67 () {56 vars in 1137 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:46.424456 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.431880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315551b-9159-485b-a2f6-7931d5387f5e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.449284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.476476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.477382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.477821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.478228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.552997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f97637-0db7-42c2-ba96-c82fc47524a5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.553561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.555036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.575504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.590765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.591368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.591641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.591908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.592542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:46.592840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.594277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.610760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 336/663] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:46.610760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.673301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 328/664] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:46.674297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.689946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.726517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e2baa-a95c-46dc-a116-5bfc4737404c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.764115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.764815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.765095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.765383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.796440 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89624539-8ce3-4c27-92c5-fe478c9a43a8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.821573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.838941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:46.839607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:46.839834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:46.840101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:46.845114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:46.847214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:46.852887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:46.858542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:46.859530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:46.860376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 329/665] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:46.861649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:46.936107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:46.969701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11d421-4b6d-4692-a617-fd0470955f46 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:46.975898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 337/666] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:46.975898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.012498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.013118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.013451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.013692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.021391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.022833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:47.034668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:47.035581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:47.036477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 330/667] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:47.036965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.060213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.082572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218ce89-fd52-49a3-b309-94c561c63cf5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.123774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.125248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.125810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.126229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.139785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.141549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.158067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249eff5-7bf4-48b6-9b4d-fab3435d3bbe None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:47.158392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:47.159453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:47.160517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:47.160517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:47.160517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:47.166649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 338/668] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:47.167691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.193020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.199414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.200020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.200299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.200567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.201232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:47.201574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.202951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.212853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 331/669] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:47.218104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.279289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671489c0-e662-494d-98ba-2b5ef370fc2e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.311669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.317833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.318469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.318749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.319015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.330350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.331661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb3cb7b-2943-4a28-8467-439b430db818 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.331787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:47.346321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:47.347283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:47.348175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:47.348175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:47.348175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:47.348175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 339/670] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:47.348175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.374284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.375277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.375558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.375831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.376581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:47.377509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.379177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.392737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 332/671] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:47.393752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.455065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.465506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ce1cb-335b-4a05-988d-aaf05863f6d5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.502404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.502873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5cb17-9ccd-4c8b-82e5-2f446e71f9ed None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.503016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.503304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.503570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.504209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:47.504516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.505923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.518312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 340/672] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:47.519138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.544964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.545621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.545905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.546173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.557295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.561012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.570922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:47.577458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:47.578394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:47.583954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:47.583954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:47.583954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:47.583954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 333/673] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:47.583954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.636366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a6198-058a-4c1f-898a-0bc368a730c5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.672480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.673265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.673602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.674436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.675075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:47.675389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.676736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.686588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef88c8-432c-43ab-89dd-bd1696418df3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.688022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 341/674] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:47.688834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.699787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.731453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.732301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.732818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.733260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.734274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=09019a1191eb4b4194c245dff90ef942) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:47.734729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.736868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.743875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 334/675] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/role_assignments?user.id=09019a1191eb4b4194c245dff90ef942&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:47.744978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.808507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d105ba7-54a2-4327-adf5-f248cb54626b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.812313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:47.855873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.856763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.857141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.857867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.868814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.871256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.881041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfe7cc-2415-4368-a425-dc999538d1f5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:47.889062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:47.891079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 342/676] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:47.897578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.935783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:47.936394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:47.936681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:47.936957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:47.937653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:47.937960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:47.939413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:47.953144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 335/677] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:47.954009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:47.995049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.027764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66830eb7-ecaa-48b3-8817-623c722ac11e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.065853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.066836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.067349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.067828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.075151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.076896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.082582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314d182-8a93-4b39-9090-4d633b56027c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:48.090965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:48.091873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 343/678] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:48.093520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.121830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.133235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.133894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.134176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.134447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.135206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:48.135522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.136979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.151412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 336/679] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:48.152279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.214736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e68cdf-b0c7-44e6-b4a5-d309743d574a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.248410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.253926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.254831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.255115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.255545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.258817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a8667-6941-47a4-adb1-60790b679c67 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.263909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.265382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5579777b-92ee-4172-9cb6-a497c5222744 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:48.278823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:48.279807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:48.280853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 344/680] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:48.281493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e373d7f-06ca-485f-8410-68dbfc05e15e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.281493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e373d7f-06ca-485f-8410-68dbfc05e15e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.281624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e373d7f-06ca-485f-8410-68dbfc05e15e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.283595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 345/681] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:48.284443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e373d7f-06ca-485f-8410-68dbfc05e15e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.304414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.305183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.305584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.305948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.306726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:48.307130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.308687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.321072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 337/682] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:48.321947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.380786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.403615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e373d7f-06ca-485f-8410-68dbfc05e15e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.430333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e3b96d-e4bc-4933-ae1a-b5db5ee9dd5e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.438287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.438894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.439691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.439973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.440696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=e0b4196792fe44f2a8fb31bba5a6006e) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:48.441001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.442489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c5c0c-390b-49e2-a1d6-d42118c9ab0b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.448669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 346/683] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/role_assignments?user.id=e0b4196792fe44f2a8fb31bba5a6006e&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:48.455404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.455923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.457044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.473173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.473918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.474272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.474615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.476139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:48.476139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.477488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.483818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:48.485796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:48.503651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 338/684] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:48.504797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.519098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.593848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 347/685] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:48.595048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.630573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ac418-3a4e-4a23-ac9a-e7e3de2ebe0f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.677206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.678598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.679044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.679594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.680490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=573e64b25ae04a47aa757ba787fc850e) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:48.680950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.682876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.692301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 339/686] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/role_assignments?user.id=573e64b25ae04a47aa757ba787fc850e&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:48.697973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.735585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a002e-5403-4ce5-a451-77e925dbf2b1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:48.780182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:48.781024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:48.781313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:48.781628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:48.864952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:48.866449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:48.930959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:48.960460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:48.990529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 348/687] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:48.998377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:49.019146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:49.055166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec0763-62f0-4719-88c8-bb9ab1a2dba4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.094492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.095123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.095932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.096211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.108023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.109719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.118705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92aa43-7327-48c9-8156-b97d131e8228 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:49.125849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:49.127117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:49.128171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:49.128171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:49.128171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:49.128171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 340/688] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:49.133170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:49.199375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.200430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.201659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.202699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.224720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.227471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:49.255501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:49.256744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:49.257897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:49.257897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:49.257897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:49.257897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 349/689] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:49.264849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:49.329499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:49.351185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a0f17-c369-43e5-990f-61a991cc1469 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.378270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:49.392000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.393118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.393599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.394013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.394821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:49.395268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.396790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.427828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 341/690] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:49.447228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:49.458294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d0c8-1a42-4c33-8f1b-69b224173c28 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.502838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.503457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.503737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.504009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.504793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:49.505099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.506911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.521467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 350/691] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:49.528085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:49.611236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f90ae-e997-43df-a5ac-6dd65523a69e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.652501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.653173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.653496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.653829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.654488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.655940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.686588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 342/692] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:28:49 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:28:49.717133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:49.730581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d71a9-daee-44af-bc57-a6159a6d77dd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.769759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.770417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.770698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.770974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.780405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.782204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:49.796581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:49.797583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:49.798564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 351/693] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:49.806723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:49.867119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:49.937064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28084c-bbe5-4b0d-b234-6d0342a0be1d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:49.976341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:49.976896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:49.977238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:49.977544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:49.978327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:49.978639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:49.980343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6ed2d-76e9-4ebe-9c92-ffc80e5061f8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:49.995055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 343/694] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:50.000932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:50.068212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9b19-87fd-47cf-9dad-b4e159074058 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.068529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9b19-87fd-47cf-9dad-b4e159074058 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.068889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9b19-87fd-47cf-9dad-b4e159074058 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.070825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 344/695] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:50.077995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.078282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.078553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.103600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:50.105034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:50.136919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096b38e-fa9a-418a-975c-c516656800a6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:50.186292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:50.187282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.187710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.188215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.188695 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 345/696] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:50.189844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=8c13a2711f2f4a0dbbc312b7a1b9034b) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:50.190317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:50.191904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:50.198880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 352/697] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:49 2022] GET /identity/v3/role_assignments?user.id=8c13a2711f2f4a0dbbc312b7a1b9034b&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:50.504578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:50.539882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:50.631508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada67310-13eb-457f-9e0b-ae69415ae12b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:50.670847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:50.671482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.671766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.672038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.691016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:50.696130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:50.697062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:50.697956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 346/698] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:50.703207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:50.722207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:50.816817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b13c34-4c8b-4e85-890c-8686c1f9b476 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:50.859125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:50.860121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.860629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.861691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.862595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:50.863106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:50.864698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be02d-936e-4fdd-a649-27d29d02115b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:50.878791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 353/699] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:50.884839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:50.890104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7da25-fbe0-41b9-8d3b-162c28b5b94e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.890707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7da25-fbe0-41b9-8d3b-162c28b5b94e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.891192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7da25-fbe0-41b9-8d3b-162c28b5b94e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.893065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 354/700] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:28:50.899485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:50.900339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:50.900625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:50.921167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:50.923227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:51.039536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 355/701] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:51.073847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:51.089587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ac943-9be8-491f-9d76-27455013aa2b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:51.138781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:51.139906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.140398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.149802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.163426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:51.165205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-99a68dba-2c5a-4133-8ea2-493795e97113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:51.180064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:51.181085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:51.182032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:51.182032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:51.182032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:51.185020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 347/702] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:51.190946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.205334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:51.342899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2845e43-3a93-4c74-9dc4-534873673bf5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:51.393372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:51.393993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.394272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.394539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.395186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:51.395490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:51.396901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:51.408225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d8a8-9fa7-4eda-9d7e-fbe8a308eca3 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.408521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d8a8-9fa7-4eda-9d7e-fbe8a308eca3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.408802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8d8a8-9fa7-4eda-9d7e-fbe8a308eca3 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.413465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 348/703] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:51.414645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 356/704] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:51.420713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.422427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.422981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.425276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.457909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:51.459283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:51.522682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:51.555127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 349/705] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:51.555127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.581261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888bc49-448d-4dde-bffd-db3a558d7534 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:51.652534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:51.653172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.653473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.653741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.667464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:51.668920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:51.693734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:51.695598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:51.698525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:51.699568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 357/706] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:51.715795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.764769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceb65e4-419c-4158-a5c7-24a8e832645e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:51.812940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:51.814738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.815274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.815775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] PATH_INFO: `/v3/services/network` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.816602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:51.818477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:51.832437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:51.833583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:28:51.834467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:51.837701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 350/707] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:51.846087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.906649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725be2b-fecf-40b9-a814-116cee8ce88b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:51.933103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:51.942418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:51.943028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:51.943307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:51.943578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:51.944438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:51.944648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:51.946560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:51.969393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 358/708] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:51.969393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:51.993641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011b849-78a0-483a-b73e-88754e68c65c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.034548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.035640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.036136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.036630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.037616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] RBAC: Adding query filter params (name=network) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:52.038135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.039992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.042380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.048064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 351/709] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:52.049806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.076101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb62000-9f1f-4cf3-bc2b-b81c477ad842 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.113988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.114654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.114892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.115162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.115748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.117101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:52.128319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:52.129453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:28:52.130396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:52.134775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 359/710] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Aug 29 23:28:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:52.135378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.166318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214935b-83d7-433f-911b-76aa9d5c607c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.194692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.204075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191f469-59a0-4e15-a162-20d5eefcf16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.204742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f469-59a0-4e15-a162-20d5eefcf16e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.204997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f469-59a0-4e15-a162-20d5eefcf16e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.205269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191f469-59a0-4e15-a162-20d5eefcf16e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.253200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900c59d-6f9c-452f-a904-91ad4d6f2d3f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.277710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.280082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f469-59a0-4e15-a162-20d5eefcf16e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.281586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191f469-59a0-4e15-a162-20d5eefcf16e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.292645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.294013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.294469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.294908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.296232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] RBAC: Adding query filter params (type=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:52.296711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.299434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f09c77-41b7-4038-b80f-1deaa88a658c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.307391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 360/711] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:52.309620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58916-304e-49a4-a908-26bd6168f4d9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.310077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58916-304e-49a4-a908-26bd6168f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.310650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e58916-304e-49a4-a908-26bd6168f4d9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.317633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 361/712] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:52.319601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58916-304e-49a4-a908-26bd6168f4d9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.406493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 352/713] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:52.409501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.410428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.410860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.440458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:52.441997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:52.459209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e58916-304e-49a4-a908-26bd6168f4d9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.475526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.510404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.511150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.511438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.511716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.512629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:52.513449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.515117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.522273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 362/714] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:52.523427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.540862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 353/715] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:52.541572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.577372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.661162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c1007-8be4-4057-af50-bf2653eedfcd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.691424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae49c438-9c9b-44fc-9b16-285d477efda1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:52.696430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31006261-2783-4678-870b-c978133c8da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.697096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31006261-2783-4678-870b-c978133c8da9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.697395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31006261-2783-4678-870b-c978133c8da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.697673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31006261-2783-4678-870b-c978133c8da9 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.698305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31006261-2783-4678-870b-c978133c8da9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:52.698609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31006261-2783-4678-870b-c978133c8da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.699982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31006261-2783-4678-870b-c978133c8da9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.706517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 354/716] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:52.707714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5a15-eddf-4657-885c-c0abbd18eb57 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.707998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5a15-eddf-4657-885c-c0abbd18eb57 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.708275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5a15-eddf-4657-885c-c0abbd18eb57 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.709806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 355/717] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:52.723798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.724133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.724340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.753657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:52.754899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:52.762199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:52.763210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:52.763689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:52.764184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:52.786471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:52.788276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:52.819886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:52.820892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:52.821817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:52.821817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:52.821817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:52.823891 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 363/718] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:52.834404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.837268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 356/719] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 29 23:28:52.873243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.887891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:52.919632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:52.964578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e72da-d026-44e8-8d5c-c6da0020088b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.005963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.006627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.006930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.007184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.007835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:53.008134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.009572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.021944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d22d5-aecc-4d91-b5af-4a8388a110a5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.023019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 364/720] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:53.029434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.091867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.092502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.092777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.093046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.111035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:53.116600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:53.117564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:53.118785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 357/721] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:53.127137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.212787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:53.226209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d798c-9d9e-47be-9cb9-7b84f823abb7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.235521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:53.259282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263f8b-3d6a-4f3b-9d85-371ca7b31225 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.268835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.269755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.270085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.270354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.278329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.280117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:53.293445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:53.294387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 365/722] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:53.295982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.302097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.302708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.302983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.303247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.303923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:53.304220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.305748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.321259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 358/723] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:53.322224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.406340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2375cd-2f8c-4786-acc1-8f466daf0b2a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.429191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e32e70-014c-45fb-9e60-b4e64b96590d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.444240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.444873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.445151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.445526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.457573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:53.464332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:53.466612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:53.468785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:53.470447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.470621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 366/724] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:53.470764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.470764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.470764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.471179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.472128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:53.474356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.474356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.489161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 359/725] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:53.490083 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.497705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:53.502191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:53.586164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3c974-5a69-4bb1-be6b-16f86b2b0ad1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.612875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ec16c-1fab-4319-a54b-67ecafe81236 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.625767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.626790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.627372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.627845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.639407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.641287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.648259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.648989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.649122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.649419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.650091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:53.650390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.651758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:53.658859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:53.659801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:53.660693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:53.660693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:53.660693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:53.661326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 360/726] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:53.662385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.667854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 367/727] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:53.669009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.732340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:53.761803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:53.768807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37495d02-d244-4ad1-9bc5-d89c8f54744e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.782356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7cd68-f85e-42f4-a681-7334d4c2df5b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:53.806025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.806513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.806796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.807068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.807793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=09019a1191eb4b4194c245dff90ef942) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:53.808099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.809656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.821763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 361/728] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/role_assignments?user.id=09019a1191eb4b4194c245dff90ef942&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:53.822823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:53.823529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:53.824437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:53.824929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:53.825447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:53.838921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:53.840818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:53.858316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:53.859324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:53.860221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:53.860221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:53.860221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:53.863406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 368/729] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:53.869222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.034334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c2e1d-5762-4ff4-9a94-8380facd876e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.050437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8545bac1-61ef-4aa0-9aaf-2937f30bb54d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.065426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:54.067138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:54.074873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.075539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.076174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.076174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.076767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:54.077071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.078633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.093244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 362/730] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:54.099297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.099995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.100850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.101330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.101841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.102691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:54.103194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.104789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.118270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 369/731] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:54.127681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.211016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9244bb00-c5c8-4ca6-9db2-b987d5eabc49 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.249404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.250064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.250344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.250614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.263621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.265073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:54.290171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:54.291162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:54.292804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 363/732] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:54.298669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.332239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7606-fbe0-4414-9b30-777b32253566 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.368876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.369735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.370015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.370283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.378782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.380462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:54.393377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:54.394382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:54.396424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 370/733] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:54.401714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:54.403289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.457197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd8857-5215-46c5-9a2e-6b9d0eaed0a5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.488214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:54.507981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.508935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.509432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.510054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.511360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:54.511814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.513501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355bf4-a67b-4be5-b50b-cda6ccf44cb3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.539183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 364/734] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:54.541440 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caec6d-3599-446c-b795-095c395b1d8a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.541903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caec6d-3599-446c-b795-095c395b1d8a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.542749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caec6d-3599-446c-b795-095c395b1d8a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.544852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 365/735] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:54.545750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caec6d-3599-446c-b795-095c395b1d8a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.577882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b1fac-ae94-457c-bebf-721ee9fe5482 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.624766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.625678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.626106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.627128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.628198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:54.628743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.630432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911dab-0d59-44c0-875e-9faf3b7309bb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.651283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 371/736] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:54.652930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.653486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.653992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.665088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caec6d-3599-446c-b795-095c395b1d8a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.674848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:54.676458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:54.677031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:54.701912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.702780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.702894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.703110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.756037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 372/737] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:54.757296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.779744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:54.789243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:54.794894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:54.867978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110d3bb-a7a1-4bf9-8a7a-3d39b0e01ab3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:54.910801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ad2d-4d40-4f5e-b02e-5b802bf80f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:54.911833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ad2d-4d40-4f5e-b02e-5b802bf80f15 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:54.912340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ad2d-4d40-4f5e-b02e-5b802bf80f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:54.912823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ad2d-4d40-4f5e-b02e-5b802bf80f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:54.942910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 366/738] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:54.948086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:54.977733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.029395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ad2d-4d40-4f5e-b02e-5b802bf80f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.031029 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ad2d-4d40-4f5e-b02e-5b802bf80f15 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.054021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.082750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42eaaa-8dde-4b7f-b9fc-e945c3e179d1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.123875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.124508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.124785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.125057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.135911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.137392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.145090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 373/739] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 29 23:28:55.145090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b83e-36a9-4fa6-9d07-79d7e1bd862a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.145090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b83e-36a9-4fa6-9d07-79d7e1bd862a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.145090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7b83e-36a9-4fa6-9d07-79d7e1bd862a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.146905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 374/740] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:55.150082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7b83e-36a9-4fa6-9d07-79d7e1bd862a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3e063df5-0279-43a1-a981-b08e5832968b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:55.162362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:55.163370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:55.164262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:55.164262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:55.164262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:55.168015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 367/741] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:55.169623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.169862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.170137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.188565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:55.189660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:55.254098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.266153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 368/742] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 29 23:28:55.269871 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7b83e-36a9-4fa6-9d07-79d7e1bd862a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.278231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.301805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.318414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.319205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.319581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.319982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.331659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.333329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:55.350700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:55.351853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:55.352956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:55.352956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:55.352956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:55.358796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 375/743] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:55.359911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.419914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc523892-f34f-4a30-9e38-28b6f7fb6857 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.471755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.473008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.473467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.474324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.475403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:55.475861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.477090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca4ed5a-4f78-41c9-87b5-46648275f2f8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.477592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.498539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 369/744] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:55.500130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.525709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.526826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.527261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.527966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.529222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.531351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.556599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 376/745] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/services => generated 240 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:55.558212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.561720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.606749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.635396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55a888-ffa9-446a-a85e-afaadefca9e7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.697456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.698273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.698617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.698906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.699551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:55.699900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.703537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.712572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cf081-2089-4c3e-9c82-4e3cf5953ac1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.719905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 370/746] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:55.721470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.762709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.763351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.763627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.763897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.772052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.773747 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:55.786999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:55.787967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:55.788850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:55.789307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 377/747] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:55.790435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.861513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b620b5-b402-4ee1-a40e-52776df5e85a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.872397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.901362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.901864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:55.902224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.902600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.903069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.903760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.905275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:55.908563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7096eb-9fc1-4643-b2d0-9256f5da829c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:55.929554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 371/748] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:28:55 2022] POST /identity/v3/services => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:28:55.930781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:55.970481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:55.971549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:55.973649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:55.974102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:55.986718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:55.990594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e81371f9-6461-4df2-8286-2f7cab15ca12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:56.004930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:56.005970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:56.006885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 378/749] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:56.008900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4304ee-f300-4159-8b33-6fa7cc7cd8c8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.008900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4304ee-f300-4159-8b33-6fa7cc7cd8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.008900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4304ee-f300-4159-8b33-6fa7cc7cd8c8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.019583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 379/750] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:56.019583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4304ee-f300-4159-8b33-6fa7cc7cd8c8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.113961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485345c-f82d-47e0-b773-d52d9ab4165d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.153136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4304ee-f300-4159-8b33-6fa7cc7cd8c8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.162124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.163017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.163474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.163911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.164791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:56.165264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.166907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2f728-e3a3-4eda-893b-a66cf8829c3e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.181586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 372/751] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:56.183177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.183638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.184103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.200743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.201423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.201709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.202038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.202791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:56.203097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.204380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:56.205145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.206530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:56.221614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 380/752] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:56.222482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.233038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:56.240108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:56.294869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 373/753] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:28:56.295745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.376311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3215c82-4bb8-4a05-a817-ae5d06715c24 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.439929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.440886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.441378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.441891 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.442817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=0b901bb69e1941158bc783a5f4c34256) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:56.444037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.445723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.458971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 381/754] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/role_assignments?user.id=0b901bb69e1941158bc783a5f4c34256&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:56.469624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba63579a-e538-4b62-83b5-d23b95a178f2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.531370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.532354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.532890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.533416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.535040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=8c13a2711f2f4a0dbbc312b7a1b9034b) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:56.535865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.538893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:56.556813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 374/755] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/role_assignments?user.id=8c13a2711f2f4a0dbbc312b7a1b9034b&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:56.597486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.692174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:56.729256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4133e7-7deb-4f7a-b3d8-7bdeab4b01db None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.769486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.770187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.770474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.770826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.784066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:56.794012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:56.795040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:56.795870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 382/756] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:56.801956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:56.836614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:56.934985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa66c5-8484-4bb3-b5cd-4d63f11659d9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:56.982172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:56.982697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:56.982975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:56.983250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:56.983917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:56.984218 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:56.985613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.000832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 375/757] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:57.006514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.148862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e909d-4c26-4c1f-8d15-9a943479449b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.195121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:57.202017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.202646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.202927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.203206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.219830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.222052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:57.240322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:57.242529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:57.244567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:57.244567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:57.244567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:57.244567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 383/758] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:57.247106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.383569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:57.403025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29719f36-ec13-4ae1-8cf2-25bc6844a3d2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.459005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.459624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.459908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.460184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.460836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:57.461202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.462994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03b62-55e9-442c-9e81-cc6f047ec320 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.481530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 376/759] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:57.487099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.591023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db3933-ee10-4de7-b261-088f83e13cc2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.605626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536bc80-f267-4950-93f4-be23d8f54c0a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.605909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536bc80-f267-4950-93f4-be23d8f54c0a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.606172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536bc80-f267-4950-93f4-be23d8f54c0a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.607791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 377/760] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:57.613293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.613621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.613905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.633936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.634840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.635331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.635785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.643889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.645678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.648496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:57.649744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:28:57.658138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:57.659079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:28:57.660032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:57.663024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 384/761] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:28:57.670295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.723048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:57.786538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e9ee3-4566-42a7-8b82-7e840fc2cb55 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:57.808158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 378/762] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:28:57.827563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:57.828174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:57.828453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:57.828726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:57.830064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:57.830488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:57.831922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:57.850673 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 385/763] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:57.856037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:57.945843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:57.973325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad875e-b902-46c4-8ed8-0f84ef0886a2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.008978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.009654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.010195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.010566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.021848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.023369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:28:58.039356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:58.040344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:28:58.041243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:28:58.041243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:28:58.041243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:58.041243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 379/764] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:58.046087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.187273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97629c7-4c03-44ad-b684-3ac95faba12a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.189499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.223031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.236765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.237399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.237679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.237943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.238580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:58.238877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.240368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.257793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 386/765] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:58.259086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.415395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee595-dfab-4857-a09f-9c138fec976b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.417524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a34c1-43b5-4a90-a762-828fdb8e8ad3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.454386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.455658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.456000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.456359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.463778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.465300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.467849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:28:58.477504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:58.478470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:58.479363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 387/766] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:58.484374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.494105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.494745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.495022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.495291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] PATH_INFO: `/v3/services/network` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.495882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.497259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.521715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:58.522998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:58.523976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:28:58.524818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:58.533616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 380/767] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:28:58 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:58.534556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.597173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a29f41-5ebe-4466-a832-ca3ffce11f1d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.635956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.636676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.637010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.637411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.638182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:58.638551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.640046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.654218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 388/768] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:28:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:58.660642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.745335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdf54d-0320-4e84-b735-8e17ef3c0a99 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.758017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.776266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bef9fa-fbb8-4b9a-97bf-8b0b196d568a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:58.791881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.792734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.793167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.793909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.795183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] RBAC: Adding query filter params (name=network) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:58.795645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.797733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091191ed-6081-4016-9262-b7a6b315f327 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.804812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 381/769] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:28:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:58.807084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741af83-125d-435b-b321-aad0e4cab8c9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.807640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741af83-125d-435b-b321-aad0e4cab8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.808067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741af83-125d-435b-b321-aad0e4cab8c9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.810503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 382/770] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:58.811350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741af83-125d-435b-b321-aad0e4cab8c9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:58.822788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d67105-fa9e-42dd-9ddf-a90c96dc2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:58.823517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67105-fa9e-42dd-9ddf-a90c96dc2c77 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.823867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67105-fa9e-42dd-9ddf-a90c96dc2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.824201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d67105-fa9e-42dd-9ddf-a90c96dc2c77 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/09019a1191eb4b4194c245dff90ef942/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.826414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67105-fa9e-42dd-9ddf-a90c96dc2c77 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=09019a1191eb4b4194c245dff90ef942, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:58.828138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d67105-fa9e-42dd-9ddf-a90c96dc2c77 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:58.846660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 389/771] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:28:58 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/09019a1191eb4b4194c245dff90ef942/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:28:58.848193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:58.848544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:58.848880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:58.874594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:58.877257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:58.888891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:58.968832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 390/772] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:28:59.006228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741af83-125d-435b-b321-aad0e4cab8c9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.061974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.062587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.062863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.063129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.063790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:59.064091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.065503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba99a2aa-15d7-4033-b0b2-2c5762406dc6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.071336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 383/773] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:28:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:59.078542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.092049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee895f5-9388-46c0-ab92-2a9045b8f582 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.092374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee895f5-9388-46c0-ab92-2a9045b8f582 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.092654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee895f5-9388-46c0-ab92-2a9045b8f582 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.097138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 384/774] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:59.100497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9d137-e92a-4410-bba3-64ca178f768e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.101023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9d137-e92a-4410-bba3-64ca178f768e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.101657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9d137-e92a-4410-bba3-64ca178f768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.128895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1ea9d137-e92a-4410-bba3-64ca178f768e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:59.130066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1ea9d137-e92a-4410-bba3-64ca178f768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:59.184529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.219157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e154d-2b2c-4d06-81d8-0860f28d8684 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.223037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 385/775] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:28:59.233281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abe6d4-f7d6-41cd-afd9-0342947a9f03 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.235298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abe6d4-f7d6-41cd-afd9-0342947a9f03 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.235828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abe6d4-f7d6-41cd-afd9-0342947a9f03 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.237801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 386/776] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:28:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:28:59.243082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.243641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.244124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.262895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.263520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.263847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.264278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.265106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] RBAC: Adding query filter params (interface=public, service_id=a6cfe27947764a1382ea8ef199370575, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:59.273602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.275512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.275762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:28:59.277196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:28:59.285325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 391/777] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/endpoints?service_id=a6cfe27947764a1382ea8ef199370575&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:59.294422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.334791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.359912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 387/778] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:28:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:28:59.361675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.422590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5f8e2-d042-411a-86bd-1d92f62c989f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.463556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.464193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.464470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.464737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.465469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.467064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.471438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.473178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d70c62-457d-490f-a527-fed1c376a7d7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:59.479071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:59.480106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:28:59.480940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:28:59.484203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 392/779] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:59.487221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.515564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.516529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.517046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.517548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.518445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.520064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.526075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 388/780] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:59.653759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.656965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909da9f-cd49-40fe-a6b3-dc825299fe84 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.713807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.714437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.714716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.714986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.715635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:59.715936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.717447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.733585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 393/781] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:28:59.741431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.760417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.835197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:28:59.836360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f9d18-1485-4aea-ab30-7988d3184a26 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.878785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.880267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.880914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.881593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.883042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce1884-898c-4a8a-b430-616a6ff5c945 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:28:59.897844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:28:59.904395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:28:59.905337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:28:59.906216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:28:59.908292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 389/782] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:28:59.908292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:28:59.929742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:28:59.930378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:28:59.930656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:28:59.930952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:28:59.931665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:28:59.931966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:28:59.933462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:28:59.939283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 394/783] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:28:59.940285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.040052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb7c06-0107-4452-b7ca-9bcdbb44af39 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.042653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.057723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97baef21-5ebd-4c56-a7af-082bb5b6e2e6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.089701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.095974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.096960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.097470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.097974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.099558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.100188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.100468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.100739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.101484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:00.101791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.103218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.114929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:00.117750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 395/784] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:00.118655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:00.120625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:00.121588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:00.122429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:00.131827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 390/785] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:00.131827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.247790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d054ea-e037-4936-83c4-e3a5dd81a776 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.268324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6950099-7d2d-48d5-b6b1-e5513364470c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.283503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.284129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.284405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.284678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.297150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.299464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.313003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.315161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:00.315273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:00.316175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:00.317081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:00.317081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:00.317081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:00.318395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.318876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.319872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] RBAC: Adding query filter params (interface=public, service_id=8e1fbc9884644e1cbab1d3ef854b7805, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:00.320424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.321177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 391/786] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:00.322102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.324281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.333888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 396/787] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/endpoints?service_id=8e1fbc9884644e1cbab1d3ef854b7805&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:00.335457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.340183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.409051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.434504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dfd1a-b8c0-48dd-99cf-9d438734afcd None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.472331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.473151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.473506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.474046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.474437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:00.474739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.475240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005afc78-3849-4753-a680-aba4bb57056a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.476112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.490604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 392/788] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:00.490604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.526091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.527286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.527286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.527286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.527884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:00.528188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.529622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.547689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 397/789] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:00.549263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.583461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.615042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0c8ac-78cc-4b49-8fae-7e8db6fe2f5d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.664107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.664962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.665657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.665931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.666824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.668124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c21bf9-f34a-4d62-a46a-35cad92d42cc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.668573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.677211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 393/790] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:00.678779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.686666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.715417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.716066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.716390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.716666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.731119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.732609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:00.755403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:00.756470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:00.757380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:00.757380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:00.757380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:00.758983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 398/791] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:00.770528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.872934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e411838e-a7a3-4878-b7de-12918b6a1f22 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:00.927082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:00.927969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:00.928427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:00.928850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:00.938184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:00.940450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:00.944644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:00.955519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:00.956720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:00.957918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:00.960451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 394/792] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:00.971286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:00.977669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a25be-9cc1-4c62-a6be-ef9efa9d24ec None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.020390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.021010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.021291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.021642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.022314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:01.022707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.023960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.047401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 399/793] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:01.052666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.085190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:01.130142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb9cf6-2987-49de-b757-1ff1d6a7cb4b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.174935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.175943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.176427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.176938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.177903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:01.178416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.180059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac08da3-fa22-446c-bff7-850df1d1b6b2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.199389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15c3a4-4e25-4e5e-8d0c-c2a09a92a8ce None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.200367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 395/794] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Aug 29 23:29:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:01.201942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2845-8277-497c-9edd-a4d25752afef None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.202434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2845-8277-497c-9edd-a4d25752afef None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.202907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a2845-8277-497c-9edd-a4d25752afef None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.205192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 396/795] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:01.214770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a2845-8277-497c-9edd-a4d25752afef None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.248200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.248956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.249236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.249547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.259954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.261443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5d9974c6-6bcc-4970-99f2-2bf36816c375 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:01.277726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:01.278761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 400/796] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:01.280315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.280976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.280976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.290924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:01.306371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:01.311260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:01.341311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a2845-8277-497c-9edd-a4d25752afef None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.387610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.388249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.388530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.388848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.401403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.402909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.406820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 401/797] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:01.407799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.427394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:01.439646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:01.440630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:01.441583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:01.441583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:01.441583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:01.441583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 397/798] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:01.447084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.531022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a88370-869c-4cb7-817c-2e8263f14c57 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.572065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.572676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.572956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.573225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.574589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:01.574895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.576343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.596477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 402/799] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:01.602784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.649571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881de86-9118-41af-b2a1-2829bbe583eb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.666074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:01.693268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.694241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.694718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.695694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.696828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:01.697328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.699921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c360b-df74-42f6-9d5e-fc2fbfdce2ff None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.717039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 398/800] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:01.718592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b70bef-dcd8-4667-9b83-ab507d1aca0a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.719099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b70bef-dcd8-4667-9b83-ab507d1aca0a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.719575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b70bef-dcd8-4667-9b83-ab507d1aca0a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.725766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 399/801] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:01.727164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.728210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:01.728930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.729715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.753226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:01.755419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:01.757281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb2a4d-a396-460a-916a-de97986c6420 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.806750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:01.807386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:01.807661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:01.807929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:01.820870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:01.822384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:01.845436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 400/802] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:01.845436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:01.845695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:01.846574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:01.847765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:01.847765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:01.847765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:01.847765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 403/803] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:01.847765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:01.976112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c7b1b-6f82-493e-994d-8f673958523d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:01.982445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:01.988242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6036e-50ef-4676-b04f-32de586ba4a4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.004439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.016338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.017146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.017531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.017873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.030623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:02.035899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.036771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.037244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.037709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:02.038752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:02.039656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:02.040509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 404/804] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:02.041201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.049989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.051706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:02.067584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:02.068674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:02.069826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:02.072139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 401/805] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:02.073095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.183982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254ab0e-cfca-4a43-833a-cf9ea8fc2271 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.194647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2be189-10a6-4e03-a351-376ded41b486 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.223836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.224819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.225145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.225432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.226072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:02.226451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.228039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.232303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.232903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.233183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.233495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.234137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:02.234433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.235833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.247662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 405/806] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:02.247662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.250663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 402/807] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:02.254592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.279018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.301365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.360786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607783a-516b-4dbb-be1b-e1d03e634bb6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.363145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e23a2-7449-43d9-8d70-6a0e9e9d231a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.407455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.409523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.410112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.410433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.411148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:02.411457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.413602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.416854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.417624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.417787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.418064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] PATH_INFO: `/v3/services/network` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.418809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.420513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:02.437673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:02.438789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:02.439718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 403/808] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:02.440546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.440938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 406/809] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:02.442880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.553816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.557997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb94951-f23c-47f3-9dec-f7073d1e4ea0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.565699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.573415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2a47-e80d-41bf-86c2-1540c9b134bc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.599167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.600049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.600049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.600328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.611512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.612052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.612160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.612345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.612585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.613612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.619548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.621058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:02.629055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:02.630064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:02.630971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:02.630971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:02.630971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:02.633192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:02.634089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:02.635738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:02.636176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 407/810] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:02.636176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.637664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 404/811] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:02.638338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.751786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68216245-599f-47bb-bd00-62b088f41faf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.756262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ca1a45-fed7-49a9-abe1-dae9d85586a3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.791950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.792557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.792836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.793109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.793782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] RBAC: Adding query filter params (name=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:02.794084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.795238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.795448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.795889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.796169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.796445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/0b901bb69e1941158bc783a5f4c34256/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.800095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 408/812] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:02.800857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.816754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=0b901bb69e1941158bc783a5f4c34256, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.818195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.821177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.828227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:02.833945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 405/813] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:29:02 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/0b901bb69e1941158bc783a5f4c34256/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:02.834749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:02.924889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27522c0-d375-43fb-b4ca-df0d9924b058 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.954279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915b440-7385-41ed-973f-46ccc3cab6b2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:02.965670 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:02.966621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.967137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.967486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.968159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:02.968536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:02.971305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d031300-b086-4860-87f2-64b0f1af92fb None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:02.989217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 409/814] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:02.990532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101432b-0484-4374-b7a9-fc28dfbfefc8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:02.990819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101432b-0484-4374-b7a9-fc28dfbfefc8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:02.991090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101432b-0484-4374-b7a9-fc28dfbfefc8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:02.992299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 410/815] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:02.992982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101432b-0484-4374-b7a9-fc28dfbfefc8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.007321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.007935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.008208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.008479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.009171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:03.009510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.010973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.025228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 406/816] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:03.030209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.083434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:03.100627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:03.106055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101432b-0484-4374-b7a9-fc28dfbfefc8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.145310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.145947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.146229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.146490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.147126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] RBAC: Adding query filter params (type=network) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:03.147423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.148796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0836eb-fbdb-4a7b-9645-dbe73841df3c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.154094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 411/817] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:03.155461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.155879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.156289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.166786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f1e9f-29e6-4b6f-ba6e-1156586f2816 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.206755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.207409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.207744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.208019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.218437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.219965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:03.232976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:03.234286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:03.235264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:03.237762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 407/818] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:29:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:03.239022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.291644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:03.292857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:03.352404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa2ad31-1cbd-4caf-9564-4b4ada73bd88 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.371120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:03.381384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 412/819] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:03.381384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.391331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.392019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.392294 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.392561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/8c13a2711f2f4a0dbbc312b7a1b9034b/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.395446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=8c13a2711f2f4a0dbbc312b7a1b9034b, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.397041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.413628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 408/820] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:29:03 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/8c13a2711f2f4a0dbbc312b7a1b9034b/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:03.414546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.468707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:03.495203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea757024-f69c-4e77-94b3-0b8d4e929eb1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.534236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.534893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.535171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.535440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.536123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.536722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11983d1f-c808-40d9-a63e-479235e73df0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.545727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.576612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.577283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.577647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.577967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.578652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:03.578952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.580463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.606626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 409/821] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:29:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:03.615372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.621686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 413/822] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:03.665829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:03.703063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.741874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a23efb-e637-4bf6-9995-b8df91bde819 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.801261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.803491 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.803928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.804351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.845969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a730603-32ad-4a6b-861b-aed5ed6ea85a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:03.878820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:03.886091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:03.887170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.888006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:03.888453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:03.888699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.889045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:03.889851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:03.891636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:03.902377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:03.903408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 29 23:29:03.904240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:03.906688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 414/823] 10.222.0.67 () {56 vars in 1129 bytes} [Mon Aug 29 23:29:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:03.913886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:03.921179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:04.022140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 410/824] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:03 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:04.028065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.043111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e042c-77c0-4c42-895d-9fa95432805c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.082067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.082690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.082963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.083238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.083885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:04.084184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.086267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.091960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 415/825] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Aug 29 23:29:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:04.098307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.145064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a173-868a-4168-9791-9c7c008f48ea None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.176849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:04.177929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:04.184546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.185592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.186088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.186556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.198528 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.200315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.214385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254e71c-5483-4c01-83f7-10a3ea2230e8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:04.217011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:04.217973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:04.218872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:04.218872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:04.218872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:04.220972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 411/826] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:04.229403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.253752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.254364 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.254654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.254900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.255527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:04.255824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.257413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.268239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 416/827] 10.222.0.67 () {56 vars in 1124 bytes} [Mon Aug 29 23:29:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:04.269117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.338041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573672b-4a37-4f54-b8f2-e6d2762b9c9e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.382025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.382673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.382957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.383225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.383329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd49ba-b642-464a-a7a5-f91b178a13da None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.383861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:04.384159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.385769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.399594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 412/828] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:04.404946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.416496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:04.432972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.434038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.434416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.434781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.437436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.440096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.454836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:04.477529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 417/829] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:04.526052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de700f-c17f-45a2-8090-58a1ef5b9e6f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.573752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.574638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.575067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.575472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.583574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.585296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:04.598452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:04.599686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:04.600779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:04.602950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 413/830] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:04.609309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.721280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f410e5-0635-46c8-893c-daaad6aaba0b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.773842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.774815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.775279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.775737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.776659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:04.777188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.778905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ca239-b0b6-4000-a38d-bb12889a633a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.793175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 418/831] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:04.799901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:04.904295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:04.909552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7593c-c106-4acf-bd1d-fa9a781cbfaa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:04.947992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:04.948598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:04.948878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:04.949149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:04.949949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=09019a1191eb4b4194c245dff90ef942) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:04.950258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:04.951708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be445496-f333-4078-8c7a-a42f473dbc8b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:04.958124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 414/832] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:04 2022] GET /identity/v3/role_assignments?user.id=09019a1191eb4b4194c245dff90ef942&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:05.001452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693065ea-7d3f-42cf-8eb8-b7aa30c20ecb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.002427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693065ea-7d3f-42cf-8eb8-b7aa30c20ecb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.002904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693065ea-7d3f-42cf-8eb8-b7aa30c20ecb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.004783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 419/833] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:05.010048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.010332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.010613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.030711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:05.031936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:05.119645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 415/834] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:05.397017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693065ea-7d3f-42cf-8eb8-b7aa30c20ecb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:05.445685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:05.510324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693065ea-7d3f-42cf-8eb8-b7aa30c20ecb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:05.545652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a2359-3a51-4f9c-bfb7-780d55e7ab38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:05.546287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2359-3a51-4f9c-bfb7-780d55e7ab38 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.546566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2359-3a51-4f9c-bfb7-780d55e7ab38 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.546839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a2359-3a51-4f9c-bfb7-780d55e7ab38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.558095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a2359-3a51-4f9c-bfb7-780d55e7ab38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ad6a2359-3a51-4f9c-bfb7-780d55e7ab38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:05.562975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:05.564579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:05.565444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 420/835] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:29:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:05.570561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:05.630730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a14e-3b08-4637-a10f-265e31626d73 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.631056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a14e-3b08-4637-a10f-265e31626d73 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.631291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400a14e-3b08-4637-a10f-265e31626d73 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.632768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 421/836] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:05.639650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.640957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.641937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.672482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:05.685335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c52db-d8ff-4c41-b842-be38245096c7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:05.687345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:05.690394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:05.841429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:05.842083 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.842408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.842613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:05.843262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:05.843589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:05.845457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:05.858317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 416/837] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:29:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:05.859162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:05.868825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 422/838] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:05.963213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de2389-467a-4384-959e-9b8c9efc7988 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:05.998397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:05.999013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:05.999288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:05.999553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.010004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.011438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:06.027289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:06.028301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:06.029215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:06.029215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:06.029215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:06.029215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 417/839] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:06.035186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.067505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.149991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.153109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56f110-d658-4dfa-9f35-62e0152a227d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.166505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.198996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.201107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.201639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.202154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.203012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:06.203554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.206376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.223635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 423/840] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:06.229403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.289422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf20f7-4203-4354-8f6f-9ac3f4583908 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.332489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.333129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.333457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.333735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.334495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.348208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59525b1-785e-406e-aa3d-a78e35a7ad5b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.349442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:06.354622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:06.355572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:06.356496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 418/841] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:06.361787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.395859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.397051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.397578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.398433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.408826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.411057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:06.427802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:06.428839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:06.429830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:06.435736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 424/842] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:06.436814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.456062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.505817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d0825-56d4-453f-af6a-3c0641e49a9a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.551548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.552549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.553038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.553285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253ac52-1ad1-44c9-93e8-9aeef2f53ff2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.553747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.554628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:06.555370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.557888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.568881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 419/843] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:06.574269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.596400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.597298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.597755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.598717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.599894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:06.600346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.602920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.631985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 425/844] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:06.634277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.650017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.705816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294973af-3f65-4b3d-8a88-324978635b3d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.736180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.746614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.747348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.747687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.748026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.752560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc965fa-f735-41fb-81e1-2996811c265f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.759698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.761169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-0dc650af-b8a1-48e7-b886-190231f718cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:06.776092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:06.777726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:06.778816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:06.778816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:06.778816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:06.778816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 420/845] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:06.778816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e71d2-6578-428f-b470-df6d6cecebbd None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.778816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e71d2-6578-428f-b470-df6d6cecebbd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.779160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e71d2-6578-428f-b470-df6d6cecebbd None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.780637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 421/846] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:06.785229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e71d2-6578-428f-b470-df6d6cecebbd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:06.797387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.798838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.799129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.799405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.872872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.874362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.885631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:06.898717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e71d2-6578-428f-b470-df6d6cecebbd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:06.936327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:06.936943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.937200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.937499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.938139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:06.938444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:06.940373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee1173-d2da-44ca-91a6-f2df324a5153 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:06.953113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 422/847] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:06.954232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb69c8a-382f-4ffc-9e06-d9f45e478ff9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:06.954512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb69c8a-382f-4ffc-9e06-d9f45e478ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:06.954782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb69c8a-382f-4ffc-9e06-d9f45e478ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:06.973779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5cb69c8a-382f-4ffc-9e06-d9f45e478ff9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:06.974973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5cb69c8a-382f-4ffc-9e06-d9f45e478ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:06.991502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 426/848] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:06.992993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.015520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.049751 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 423/849] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:07.051007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97ad5a-35fd-4b36-9a9e-662fab740003 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.051288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97ad5a-35fd-4b36-9a9e-662fab740003 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.051558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97ad5a-35fd-4b36-9a9e-662fab740003 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.052781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 424/850] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:07.053501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97ad5a-35fd-4b36-9a9e-662fab740003 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.107581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b43a-7137-496f-a8b3-94c4107a47b5 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.120350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.158437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.159069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.159347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.159701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.167483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.169011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.170076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97ad5a-35fd-4b36-9a9e-662fab740003 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-43706d86-9a2d-404a-b5ba-fe46389f280b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:07.181387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:07.182452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:07.183506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 427/851] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:07.184105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.184105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.184227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.203720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:07.204939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:07.211028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.211659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.211937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.212210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.223471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.225122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:07.240704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:07.241787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:07.242696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:07.242696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:07.242696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.242696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 425/852] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:07.243471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.272397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.285397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 428/853] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:07.285397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.358058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e965aff-b39c-42d1-b4ef-22fd7dc72db6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.392867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.393779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.394230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.394682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.395417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:07.395723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.397172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.397289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.405133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793bf7d-87e2-4722-b828-bf1af8aca560 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.429450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 426/854] 10.222.0.67 () {56 vars in 1135 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:07.430886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.462732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.463351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.463634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.463909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.464556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:07.464857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.466262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.478396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 429/855] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:07.479107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.524649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.546707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668c594-0d45-4dcd-9d22-ca629ff1c472 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.583201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.583832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.584114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.584387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.584969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.586379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.590607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b203ed-1459-4ef6-bd49-f097f63adce6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:07.596047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:07.597297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.598201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 427/856] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:07.599005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.630784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.631392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.631673 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.631942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.660129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.701476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4526b-a130-406f-81bc-6b877adc00ba None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.703941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.705955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.735119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.735762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.736034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.736300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.743169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.744577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:07.755992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:07.757258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 428/857] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:07.758472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.761874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.810668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 430/858] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:07.811426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.863993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc799a3-03de-46ff-a294-438e4853b0f4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.869858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:07.901978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.902756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.903140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.903530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.904207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.905701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.912851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005e591-1f4a-4d41-81a0-6b21a9065a08 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:07.914605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:07.915815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:07.916864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:07.921233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 429/859] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:07.922075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.949704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:07.950486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:07.950857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:07.951201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:07.951900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:07.952266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:07.953702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:07.958673 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 431/860] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:07.959454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:07.988992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.023525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5607c09-4adc-4fa9-8155-d6e3081d70c8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.057045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.057685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.057948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.058220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.059171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.059171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.060617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.061751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26afdd-59ee-4c91-954c-0ec62b4e029a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.072951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 430/861] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.073965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.087149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.099883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.100854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.101342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.101881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.113075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.123998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:08.139627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:08.140581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:08.141515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:08.141515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:08.141515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:08.141515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 432/862] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:08.143283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.200963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc6293-382c-40dd-a154-c04e19866cb1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.243536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.251960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba46094-2e0d-41b2-a96e-beee524e633a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.253495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.254320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.254742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.255178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.256111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.256448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.257930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.263291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 431/863] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.264466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.289020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.289652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.289923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.290183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.290815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.291109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.292472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.297065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 433/864] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.298376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.351148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.380718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f589f39-22e1-4b6e-8133-f3c9664ecf0d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.419805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.420406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.420693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.421043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.421878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=0b901bb69e1941158bc783a5f4c34256) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.422710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.424171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.429852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c761b4d-cf92-4b3e-815e-05f1445a006d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.430964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 432/865] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/role_assignments?user.id=0b901bb69e1941158bc783a5f4c34256&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.431628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.496122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.496619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.496898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.497170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.498209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.498209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.498209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.514829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 434/866] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.522528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.524822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.587853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f4772-4a22-4026-80f8-49d907fa056f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.633878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.634492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.634773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.635040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.636150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.636548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.638975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.644047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 433/867] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.650397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.655368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5519142-5e6a-4772-a5b3-d05f0c12ac96 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.701052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.702061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.702495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.702929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.711269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.713027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:08.726769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:08.727936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:08.729166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 435/868] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:08.734322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:08.852982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3409268-14fe-4605-94aa-00bd50d3492f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:08.874829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:08.892455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:08.893038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:08.893321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:08.893620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:08.894324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:08.894629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:08.896084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dbca4e-3a27-4dcd-b5b6-a6a547dac8bf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:08.910805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 434/869] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:08.917027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:09.027811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef2534-075f-4577-8079-154100aa4686 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:09.066849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:09.067522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:09.067869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:09.068195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:09.068935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=8c13a2711f2f4a0dbbc312b7a1b9034b) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:09.069242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:09.070707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5bda0-fe4f-43b5-bf09-4cd244f1752b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:09.077542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 436/870] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:08 2022] GET /identity/v3/role_assignments?user.id=8c13a2711f2f4a0dbbc312b7a1b9034b&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:10.319369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd13ce2-c1e1-4cbe-b510-ebe863e4d312 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.319925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd13ce2-c1e1-4cbe-b510-ebe863e4d312 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.319925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd13ce2-c1e1-4cbe-b510-ebe863e4d312 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.321264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 435/871] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:10.326665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded7ba-254f-4f47-9dee-3ff6df079cfb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.327067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded7ba-254f-4f47-9dee-3ff6df079cfb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.327209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fded7ba-254f-4f47-9dee-3ff6df079cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.347784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3fded7ba-254f-4f47-9dee-3ff6df079cfb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:10.348965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fded7ba-254f-4f47-9dee-3ff6df079cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.367973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:10.420845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 437/872] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:10.613307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4c92-59d6-4976-9f03-c1201a786f9d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.613677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4c92-59d6-4976-9f03-c1201a786f9d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.613893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d4c92-59d6-4976-9f03-c1201a786f9d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.615489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 436/873] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:10.620716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d08a7-5c73-4bcd-b1ac-f7c3cce522b3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.621008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d08a7-5c73-4bcd-b1ac-f7c3cce522b3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.621286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d08a7-5c73-4bcd-b1ac-f7c3cce522b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.639993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f54d08a7-5c73-4bcd-b1ac-f7c3cce522b3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:10.641178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f54d08a7-5c73-4bcd-b1ac-f7c3cce522b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.697674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d4c92-59d6-4976-9f03-c1201a786f9d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:10.733985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 438/874] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:10.815563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d4c92-59d6-4976-9f03-c1201a786f9d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:10.851697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8ecaf-1bda-4dbc-9654-57c5cb70c374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:10.852298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8ecaf-1bda-4dbc-9654-57c5cb70c374 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.852575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8ecaf-1bda-4dbc-9654-57c5cb70c374 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.852844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8ecaf-1bda-4dbc-9654-57c5cb70c374 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.853529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8ecaf-1bda-4dbc-9654-57c5cb70c374 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:10.854891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8ecaf-1bda-4dbc-9654-57c5cb70c374 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:10.868140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6a87-ac53-4f39-b482-a89902910712 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.868752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6a87-ac53-4f39-b482-a89902910712 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.869221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577d6a87-ac53-4f39-b482-a89902910712 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.874862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 437/876] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:10.875220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 439/876] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:10.877320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7863-3f91-4f05-b3be-3d4291b25d10 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:10.877929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7863-3f91-4f05-b3be-3d4291b25d10 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:10.878439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7863-3f91-4f05-b3be-3d4291b25d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:10.899657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-176f7863-3f91-4f05-b3be-3d4291b25d10 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:10.901327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-176f7863-3f91-4f05-b3be-3d4291b25d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:10.947058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:10.992791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 438/877] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:11.020862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6a87-ac53-4f39-b482-a89902910712 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.108596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48c56-ffc3-410e-bdae-ab59d88f5f36 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.108912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48c56-ffc3-410e-bdae-ab59d88f5f36 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.109149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de48c56-ffc3-410e-bdae-ab59d88f5f36 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.109678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:11.111346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 439/878] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:11.116710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.117234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.117341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.133106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577d6a87-ac53-4f39-b482-a89902910712 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:11.138240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:11.139438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:11.187772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:11.188659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.189000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.189274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.190073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:11.193048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:11.214205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 440/879] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:11 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:11.251378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 440/880] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:11 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:11.269455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.384563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf05599-3395-4f2b-8caf-027a6b00fa12 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:11.423166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:11.423800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.424076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.424338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.435354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:11.440575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:11.441579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:11.442704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 441/881] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:11.449815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.555062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:11.559180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.562552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:11.565167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eaf3b6-7127-4ac8-9197-8cf43e8c8b52 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:11.602952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:11.603565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.603843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.604111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.604786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:11.605086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:11.606492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:11.620663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 441/882] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:11.622349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.685775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa96608-37e1-4e05-a1dd-fcc0fd458387 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:11.725095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:11.725764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.726038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.726303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.726886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:11.728641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:11.738345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:11.739612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:11.740668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:11.744465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 442/883] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:11.745916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.752133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb3835-bacc-4a7d-9ef7-bfd767535c1b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:11.798239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:11.799158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.799468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.799744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.815582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:11.817225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:11.821368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:11.839117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:11.840122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:11.846131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:11.846131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:11.846131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:11.846131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 442/884] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:11.847790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.860218 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:11.870104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cf18b-3bde-4ffc-a860-f579c140e3de None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:11.909721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:11.910503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:11.910881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:11.911248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:11.912149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:11.912551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:11.914189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:11.927234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 443/885] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:11.928780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:11.992005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d680e-b324-4eb7-b626-18d288b9d8ef None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:12.037549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:12.038715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.040021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.040541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.041769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:12.042308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:12.044942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:12.053559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de0dc6-adb7-4284-b8b1-7b791b3777e8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:12.067680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 443/886] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:12.069645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:12.094406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:12.104182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:12.105084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.105855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.106357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.108062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:12.108558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:12.110665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:12.123609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 444/887] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:12.154146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:12.195308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ba54d-54cc-4ecd-be32-8e04cd377685 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:12.233727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:12.234366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.234643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.234914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.243971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:12.245577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:12.259959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:12.260971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:12.262534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 444/888] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:29:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:12.269328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:12.385884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ebf8e-f703-444e-afab-2e11b3e9435e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:12.421922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:12.422540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.423438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.423715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.424518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:12.424827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:12.426286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:12.444931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 445/889] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Aug 29 23:29:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:12.450729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:12.563718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a3100-e210-4c0b-a5b6-be0abf6e335f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:12.589828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:12.599641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2466b-9a7d-44dd-a7e8-c96c859b67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:12.600244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2466b-9a7d-44dd-a7e8-c96c859b67dd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.600511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2466b-9a7d-44dd-a7e8-c96c859b67dd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.600774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2466b-9a7d-44dd-a7e8-c96c859b67dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.676629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2466b-9a7d-44dd-a7e8-c96c859b67dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:12.678163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2466b-9a7d-44dd-a7e8-c96c859b67dd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:12.786049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 445/890] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:12 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:12.791749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:12.849438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:12.883660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66f1f-0094-4919-9f19-50c8d6ae4bc3 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.884008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66f1f-0094-4919-9f19-50c8d6ae4bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.884221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e66f1f-0094-4919-9f19-50c8d6ae4bc3 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.885870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 446/891] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:12.891360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.891740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.891949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.905032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d37a3-0f0e-4ae0-965e-03a669ef4b95 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:12.910476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:12.911674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:12.937791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:12.945539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:12.946267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:12.946548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:12.946819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:12.957848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:12.959437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:12.975476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:12.977761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:12.979592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:12.979592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:12.979592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:12.979592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 446/892] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:12.986589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 447/893] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:12.989378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.097963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a4997-03a7-470f-8d5c-855770ba4ae2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.100324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.133661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.134264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.134539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.134868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.135528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:13.135826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.137203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.150292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 447/894] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:13.159532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.265533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b919e-b0cb-4904-a574-aaa54aa09cb5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.286542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.312449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.313090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.313460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.313719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.320714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.322197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-7beb563e-f130-4794-b39a-c83003e4a1c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:13.333455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:13.334356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 448/895] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46fef-117f-4af0-b4d0-26688065326a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.341078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46fef-117f-4af0-b4d0-26688065326a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.342036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c46fef-117f-4af0-b4d0-26688065326a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.342036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 449/896] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:13.343047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.343333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.343900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.363500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:13.365993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:13.381784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.406981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287574d-1562-4cde-8e97-2c53d454d608 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.444401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.445017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.445290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.446734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.446734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.447487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:13.457402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:13.458407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:13.459823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 448/897] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:13.460691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.461098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 450/898] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:13.469392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.531194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.602339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365764f-cf9c-42b9-864c-ed7afea9a20e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.610170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368e10c-234b-4e0b-a782-1e52a4276c84 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.638209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.638813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.639084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.639354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.639982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:13.640278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.642241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.646965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c82214-455f-415b-b871-72bed592c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.647551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 451/899] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:13.649813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c82214-455f-415b-b871-72bed592c248 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.650099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c82214-455f-415b-b871-72bed592c248 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.650371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c82214-455f-415b-b871-72bed592c248 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.651077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c82214-455f-415b-b871-72bed592c248 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:13.651374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c82214-455f-415b-b871-72bed592c248 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.652844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c82214-455f-415b-b871-72bed592c248 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.654293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.668590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 449/900] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:13.670336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.674662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c82214-455f-415b-b871-72bed592c248 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.767277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d595-9f15-40d7-9879-0c89c103f727 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.787411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.802765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c82214-455f-415b-b871-72bed592c248 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.804381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.804991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.805268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.805584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.806217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:13.806520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.807890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.817723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 452/901] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:13.817723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.843525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.844122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.844421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.845455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.846023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] RBAC: Adding query filter params (role.id=7be9601dde0a47e19ed4924d863b92e8, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=0b901bb69e1941158bc783a5f4c34256) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:13.846319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.847757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.853365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 450/902] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/role_assignments?user.id=0b901bb69e1941158bc783a5f4c34256&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=7be9601dde0a47e19ed4924d863b92e8 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:13.853994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:13.912527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:13.943990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcda042-4259-4230-94d4-8e8743b634ec None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:13.983703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:13.984435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:13.984615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:13.984862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:13.985557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:13.986966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:13.996874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:13.997932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:13.998830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 453/903] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:14.004692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.007686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a8868-0775-4042-afb7-ce67ef9c30d1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.052946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.054063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.054565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.055420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.056626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] RBAC: Adding query filter params (interface=public, service_id=91cd5e21350d469aacca1becffdec42f, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:14.057139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.059151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.071525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 451/904] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:29:13 2022] GET /identity/v3/endpoints?service_id=91cd5e21350d469aacca1becffdec42f&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:14.073335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.098370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:14.115888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa746a-fcee-45ec-98fe-88f0356b87d9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.161177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea937e-0cac-4154-a876-41034716debb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.161819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea937e-0cac-4154-a876-41034716debb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.162093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea937e-0cac-4154-a876-41034716debb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.162365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea937e-0cac-4154-a876-41034716debb None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.162983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea937e-0cac-4154-a876-41034716debb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:14.163280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea937e-0cac-4154-a876-41034716debb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.164644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea937e-0cac-4154-a876-41034716debb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.170193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 454/905] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:14.170784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d320b0-8d4a-4c47-b38b-5e34923589d6 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.171066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d320b0-8d4a-4c47-b38b-5e34923589d6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.171359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d320b0-8d4a-4c47-b38b-5e34923589d6 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.176693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 455/906] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:14.176693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d320b0-8d4a-4c47-b38b-5e34923589d6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.179013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:14.212121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5bfbf-e655-4f09-b8a5-5b42d4d7ea99 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.250613 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ab951-53d3-4c33-8d36-663fbc84cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.251762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab951-53d3-4c33-8d36-663fbc84cc0e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.252059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab951-53d3-4c33-8d36-663fbc84cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.252324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab951-53d3-4c33-8d36-663fbc84cc0e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.252921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab951-53d3-4c33-8d36-663fbc84cc0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.254285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab951-53d3-4c33-8d36-663fbc84cc0e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.260216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 452/907] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:14 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:14.262743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.263099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.263444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.289169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:14.291355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:14.301240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d320b0-8d4a-4c47-b38b-5e34923589d6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.346521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.347863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.348526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.349185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.350092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:14.350587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.352195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.363650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 456/908] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:14.365582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.397383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 453/909] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:14.446230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:14.484574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ee82-f104-475e-bed3-370c7d9ed9a5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.520789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.521420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.521700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.521973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.522676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] RBAC: Adding query filter params (interface=public, service_id=965fedca38e74b66a66d2840f0a47403, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:14.522982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.524360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.533133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 457/910] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:29:14 2022] GET /identity/v3/endpoints?service_id=965fedca38e74b66a66d2840f0a47403&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:14.538780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.557963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:14.648079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b8507-5860-4976-9593-63c40cc71dcc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.682653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972b9d-a267-4094-8013-2e1c1d33b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.683267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972b9d-a267-4094-8013-2e1c1d33b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.683547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972b9d-a267-4094-8013-2e1c1d33b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.683817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972b9d-a267-4094-8013-2e1c1d33b0e7 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.684421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972b9d-a267-4094-8013-2e1c1d33b0e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.685823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972b9d-a267-4094-8013-2e1c1d33b0e7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.692412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 454/911] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:14 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:14.700960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:14.825107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3224-2b94-446d-af3c-79d275d85333 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:14.858040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:14.863694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6c75b-732c-4306-adc5-bc88ff8a9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:14.865138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c75b-732c-4306-adc5-bc88ff8a9e4d None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:14.865447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c75b-732c-4306-adc5-bc88ff8a9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:14.865716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6c75b-732c-4306-adc5-bc88ff8a9e4d None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:14.866375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c75b-732c-4306-adc5-bc88ff8a9e4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:14.867755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6c75b-732c-4306-adc5-bc88ff8a9e4d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:14.888129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 458/912] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:14 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:15.835404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356046-1ea5-49c3-bcb5-386676c07b22 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.836061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356046-1ea5-49c3-bcb5-386676c07b22 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.836061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356046-1ea5-49c3-bcb5-386676c07b22 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.837964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 455/913] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:15.844005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e475-7350-4d29-8134-b80f62b51ae0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:15.845124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e475-7350-4d29-8134-b80f62b51ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:15.845124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751e475-7350-4d29-8134-b80f62b51ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:15.864705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2751e475-7350-4d29-8134-b80f62b51ae0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:15.865935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2751e475-7350-4d29-8134-b80f62b51ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:15.956776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 459/914] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:16.232031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356046-1ea5-49c3-bcb5-386676c07b22 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.242698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55a43-6c33-49ac-9122-af46d04deebe None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.243337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55a43-6c33-49ac-9122-af46d04deebe None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.243821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e55a43-6c33-49ac-9122-af46d04deebe None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.245620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 460/915] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:16.251221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.251757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.252233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.271536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:16.273091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:16.315643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.345574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356046-1ea5-49c3-bcb5-386676c07b22 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.353376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 461/916] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:16.386273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.386912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.387189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.387459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.399092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:16.403975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:16.404979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:16.405940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 456/917] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:16.411289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.469777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.522434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368c2a-54a0-407a-b1b8-95b0fb1cf828 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.566179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.566779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.567065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.567379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.568042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:16.568389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.569787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.578542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 462/918] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:16.584116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.633219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.708168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecea23e-63a2-41d7-b656-97513b24508f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.749381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.750053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.750333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.750651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.754342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.755779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab8b48-2e6d-44ee-997b-8e280831a2c4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.767427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:16.767651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.768951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8b903db6-0189-44d7-985f-6c5ca402f649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:16.785095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:16.786168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:16.787061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:16.787061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:16.787061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:16.787061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 457/919] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:16.787676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed691-c278-4da9-aa25-ad58ab29a160 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.787676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed691-c278-4da9-aa25-ad58ab29a160 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.787940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ed691-c278-4da9-aa25-ad58ab29a160 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.789340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 458/920] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:16.792016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ed691-c278-4da9-aa25-ad58ab29a160 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.802618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81de522-73db-4553-a356-244ddf123308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.803246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81de522-73db-4553-a356-244ddf123308 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.803524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81de522-73db-4553-a356-244ddf123308 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.803796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81de522-73db-4553-a356-244ddf123308 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.804380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81de522-73db-4553-a356-244ddf123308 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.805797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81de522-73db-4553-a356-244ddf123308 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e81de522-73db-4553-a356-244ddf123308 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:16.815455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:16.816505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:16.817378 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 463/921] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:16.818580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.818580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.818580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.836632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:16.838420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:16.912789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 464/922] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:16.918008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:16.932563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ed691-c278-4da9-aa25-ad58ab29a160 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:16.970254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:16.970776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.971053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.971320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.972046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:16.972306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:16.973675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f340f01f-4015-4c1c-8cc0-ac23cef0c4c5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:16.989518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 459/923] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:16.989518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dbe64-2f69-4ade-94cb-7b575ec3c558 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:16.989518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dbe64-2f69-4ade-94cb-7b575ec3c558 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:16.989518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dbe64-2f69-4ade-94cb-7b575ec3c558 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:16.989897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 460/924] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:16.994836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dbe64-2f69-4ade-94cb-7b575ec3c558 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.025879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9cda-9145-42a3-be48-92a70a036d2c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.027530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.045221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.067351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.067839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.068124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.068608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.069317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:17.069700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.071798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb5be-dcdb-4de6-b351-c6e8ab97dbf3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.076913 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 465/925] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:17.084220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.084505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.084778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.104933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dbe64-2f69-4ade-94cb-7b575ec3c558 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.107880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:17.109072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:17.142478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.143108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.143388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.143657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.152560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.154982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:17.170321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:17.171316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:17.172287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:17.176825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 461/926] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:29:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:17.177760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.189463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 466/927] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:17.190319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.287349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45e095-9f33-4145-8e63-2cad75d193a8 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.294277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.300981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.308506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b536-6aee-4da3-8220-b888f7812dda None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.322383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.322920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.323271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.323477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.324094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:17.324395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.325807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.331411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 462/928] 10.222.0.67 () {56 vars in 1114 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:17.332208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.352312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.352864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.353144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.353514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.354173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:17.354468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.355888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.378482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 467/929] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:17.378482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.449394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06cba6-6928-405a-97ca-a52223f74cd1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.486428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116af37f-6643-495d-baa4-d9787c5aea41 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.490657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.491280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.491554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.491823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.492404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.493816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:17.502414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:17.503542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:17.504434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 463/930] 10.222.0.67 () {56 vars in 1132 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:17.505245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.526755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.527353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.527685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.527900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.528558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.529989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.538372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.552534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 468/931] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:17.553371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.569010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.615183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c17146-f924-4bc6-b091-b372e600bc5d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.662981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.663624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.663902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.664172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.675707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.675922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4342-b0de-47de-975d-2ce1702a296d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.677192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:17.696594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:17.697903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:17.699016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:17.699016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:17.699016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:17.702598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 464/932] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:17.703475 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.721003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.721681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.722279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.722279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.722798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.724175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:17.733909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:17.735217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:17.736222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 469/933] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:17.737204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.800135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.820815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad709ec-49b7-4297-b173-d85dbfae20bf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.827672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:17.856916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.857564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.857843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.857949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409b1f6-ee77-4f41-abe2-85af6a8cc0f1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:17.858123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.858749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:17.859049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.860556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.870123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 465/934] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:17.870123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.907107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:17.907706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:17.907981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:17.908248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:17.908884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:17.909182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:17.910586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:17.922508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 470/935] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:17.927851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:17.989563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e65b81-16b3-4c51-b536-287e1ddd07ba None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.025984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.026589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.026863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.027131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.027752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:18.028048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.029433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.034357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 466/936] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:18.035267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.046895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebcb9c-84cd-44f8-a3d7-b087826325ce None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.048409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:18.090870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.091390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.091667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.091932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.092560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:18.092859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.094270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.096032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:18.101277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 471/937] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:18.102189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.152629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8b71a-40ba-4af6-b44e-e8a1a1f129b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.191681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.192243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.192518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.192800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.200323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.202556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.214027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e686bd2-542a-41b6-8158-aa85ca6c5ed5 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:18.215931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:18.216852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 467/938] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:18.218216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.258702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.259710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.260197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.260684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.261464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:18.261877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.263370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.273327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 472/939] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:18.273327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.297953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:18.331874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab2cae-9c5a-4715-966d-6a5349f4ffb3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.338334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:18.368529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.369632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.370124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.370599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.371450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.373332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.380625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4db6eb-f9ca-453c-9c91-26e7558c7d4b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.397479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 468/940] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:18 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:18.398695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.429149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.429975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.430383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.430728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.431509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:18.431885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.433737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.455456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 473/941] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:18.456968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.544415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc5f39-72c0-4f61-8df9-7cbb1c435644 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.577281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:18.582651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad264-dd5f-4eb8-909b-b8c1a23e9a06 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.596762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.596958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.597252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.597526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.598244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] RBAC: Adding query filter params (interface=public, service_id=c237828e4aef4d18a6495553febad2f1, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:18.598552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.599931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.606348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 469/942] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:29:18 2022] GET /identity/v3/endpoints?service_id=c237828e4aef4d18a6495553febad2f1&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:18.611104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:18.613763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:18.638703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30072827-9f1b-4624-a18f-f24decc37cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.639547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30072827-9f1b-4624-a18f-f24decc37cb8 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.639822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30072827-9f1b-4624-a18f-f24decc37cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.640093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30072827-9f1b-4624-a18f-f24decc37cb8 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/0b901bb69e1941158bc783a5f4c34256/roles/7be9601dde0a47e19ed4924d863b92e8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.643481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30072827-9f1b-4624-a18f-f24decc37cb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=0b901bb69e1941158bc783a5f4c34256, role_id=7be9601dde0a47e19ed4924d863b92e8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.646093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30072827-9f1b-4624-a18f-f24decc37cb8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.665422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 474/943] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:29:18 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/0b901bb69e1941158bc783a5f4c34256/roles/7be9601dde0a47e19ed4924d863b92e8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:18.740439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae16cc-10bd-41f9-a82c-a6c7b3fb71c0 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:18.779902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6557b1-4dd2-416c-aaa5-cec619761111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:18.780940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6557b1-4dd2-416c-aaa5-cec619761111 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:18.781421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6557b1-4dd2-416c-aaa5-cec619761111 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:18.781924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6557b1-4dd2-416c-aaa5-cec619761111 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:18.783192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6557b1-4dd2-416c-aaa5-cec619761111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:18.784814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6557b1-4dd2-416c-aaa5-cec619761111 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:18.793232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 470/944] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:18 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:19.538935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13f9d-0ef6-4746-aa4f-b46a84925032 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:19.539529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13f9d-0ef6-4746-aa4f-b46a84925032 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:19.539529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13f9d-0ef6-4746-aa4f-b46a84925032 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:19.540925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 475/945] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:19.546303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:19.546728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:19.546894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:19.567789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:19.568988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:19.621028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:19.639928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 471/946] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:19.905857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13f9d-0ef6-4746-aa4f-b46a84925032 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:20.017468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13f9d-0ef6-4746-aa4f-b46a84925032 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:20.053777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:20.054450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.054779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.055056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.055708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:20.057138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:20.059825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING keystone.server.flask.common [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 29 23:29:20.079050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.sql.core [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:29:20.079050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 23:29:20.079050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [parameters: {'id': '88e07d0b62e748058fb6bd73293b6207', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 23:29:20.079050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81694) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 88e07d0b62e748058fb6bd73293b6207.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 88e07d0b62e748058fb6bd73293b6207. Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:29:20.097229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 29 23:29:20.099173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application yield resource Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise self.value Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application session.commit() Aug 29 23:29:20.100516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:29:20.101806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:29:20.102946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:29:20.104917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [parameters: {'id': '88e07d0b62e748058fb6bd73293b6207', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.107077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:20.114885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 88e07d0b62e748058fb6bd73293b6207. Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.117085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 476/947] 10.222.0.67 () {60 vars in 1140 bytes} [Mon Aug 29 23:29:19 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:20.118430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:20.210877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a4aae-d76f-4335-b1fe-cd6d51da208b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:20.247400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:20.248050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.248334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.248613 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.256210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:20.257738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-90abf84c-d679-4f32-87f2-8ebf21824461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:20.273172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:20.275309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:20.277328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 472/948] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:20.281143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:20.321889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:20.391741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e804a-74f2-4022-a1f5-15fd691be161 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:20.404874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc7be-5011-4c09-a7ce-7d80b83b61b4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.405179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc7be-5011-4c09-a7ce-7d80b83b61b4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.405440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdc7be-5011-4c09-a7ce-7d80b83b61b4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.407602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 473/949] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:20.412553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74849-a26f-44af-88b9-37c70131d77c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.412831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74849-a26f-44af-88b9-37c70131d77c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.413101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de74849-a26f-44af-88b9-37c70131d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.433678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7de74849-a26f-44af-88b9-37c70131d77c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:20.434860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7de74849-a26f-44af-88b9-37c70131d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:20.435150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:20.435756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.436036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.436307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.437228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:20.438404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:20.440109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2638afc-19b9-45f8-b443-4ce982a529d5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:20.467542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 477/950] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:20.485602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:20.519581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 474/951] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:20.727970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b097e-8677-4c3f-bfe9-3a48839127d1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.727970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b097e-8677-4c3f-bfe9-3a48839127d1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.727970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67b097e-8677-4c3f-bfe9-3a48839127d1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.727970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 478/952] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:20.737282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04e57-2ff0-4d5f-81da-df720365cbf0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.737282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04e57-2ff0-4d5f-81da-df720365cbf0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.737282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca04e57-2ff0-4d5f-81da-df720365cbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.754873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aca04e57-2ff0-4d5f-81da-df720365cbf0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:20.756396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aca04e57-2ff0-4d5f-81da-df720365cbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:20.784198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b097e-8677-4c3f-bfe9-3a48839127d1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:20.831687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 475/953] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:20.833788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e916c-70f3-4fec-a80b-06f27b893eb9 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.834233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e916c-70f3-4fec-a80b-06f27b893eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.834659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e916c-70f3-4fec-a80b-06f27b893eb9 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.836998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 476/954] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:20.842299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.842586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.842863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.862821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:20.864025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:20.894360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:20.902665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67b097e-8677-4c3f-bfe9-3a48839127d1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:20.938598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:20.939227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:20.939500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:20.939766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:20.940343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:20.941746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:20.950967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:20.952070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:20.952935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:20.954380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 477/955] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:20.957545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 479/956] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:20.958859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:20.994574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.064850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d86384-0821-4c46-bb0b-561de91b8eb0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.100145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.100756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.101017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.101292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.101956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:21.102247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.103811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.109203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 478/957] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:21.115261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.117113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.235494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfd8f3-cb4f-4404-ac35-f286f605508c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.239759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.245763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90403b-cd2a-442a-9644-b01a352ee70e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.274338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.274953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.275232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.275508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.276136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:21.276442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.277852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.282782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 480/958] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:21.283579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.292572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.293641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.294125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.294584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.307558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:21.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:21.314442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:21.315286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:21.315955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.318064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 479/959] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:21.325036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.429222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbaae72-1e47-4d79-8b62-2c6a4e731741 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.457064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d41274-17fc-4e97-b0b9-ab6b50d0bf9f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.474804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.475557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.475838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.476160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.476693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.478253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:21.488380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:21.489479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:21.490328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 481/960] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:21.495580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.505001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.506404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.506866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.507282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.508540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:21.509042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.511270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.523551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 480/961] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:21.529417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.569734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.596146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.615457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0018f-a043-4503-858c-671ef1aebd4a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.652685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4db9b6-7a91-47b3-ab14-8974190c45e4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.656278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.657699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.658234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.658706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.659534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:21.660046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.661798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.667841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 482/962] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:21.674164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.691150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.691787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.692067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.692339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.703294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.705300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:21.720634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:21.721694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:21.722612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:21.722612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:21.722612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:21.725475 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 481/963] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:21.728124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.794295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063be0d4-72c5-490b-b0ae-178973dceee3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.800702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.832918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.833745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.834031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.834303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.834941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:21.835246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.836677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.845927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19aa6c-0bec-42f5-8057-8163614ccaa4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:21.847727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 483/964] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:21.849044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.871327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:21.897372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:21.898112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:21.898397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:21.898669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:21.899330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:21.899633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:21.901016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:21.918937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 482/965] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:21.920265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:21.967405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cb090-b586-46e2-a480-3d4f426cce38 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:22.010644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:22.011249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.012040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.012317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.012986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:22.014836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:22.041552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ef3ee-2a39-4514-a7dc-9926409d9d33 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:22.045942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 484/966] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:22.077273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:22.090848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:22.091495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.091768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.092034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.101435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:22.102907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:22.116167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:22.117203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:22.118212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 483/967] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:29:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:22.123331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:22.222142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:22.257233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761dd3-fe1d-4e66-bb87-c8549f5aaf2e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:22.294143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:22.294812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.295113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.295380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.296158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:22.296399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:22.297892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088f863-d547-4364-975e-ea5e50a61596 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:22.317198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 485/968] 10.222.0.67 () {56 vars in 1149 bytes} [Mon Aug 29 23:29:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:22.323065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:22.436492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7aed7-822f-4a70-9737-2507d840d986 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:22.475694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:22.476306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.476580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.476847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.507227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8bd0-6d0b-4bf7-9c34-a5061cec2a7e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.507560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8bd0-6d0b-4bf7-9c34-a5061cec2a7e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.507828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8bd0-6d0b-4bf7-9c34-a5061cec2a7e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.509283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 486/969] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:22.514454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.514746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.515043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.533448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:22.534970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:22.544008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:22.557869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:22.559311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:22.616533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 487/970] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:22.668588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 484/971] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:22 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:22.674790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:22.736732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:22.779788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a36df1-ffe1-4e7a-a935-6ea1fb24fb0b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:22.816174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:22.816790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:22.817014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:22.817242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:22.827871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:22.829485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:22.845450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:22.846463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:22.847365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:22.847365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:22.847365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:22.851302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 488/972] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:22.852664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:22.889641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:22.947820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:22.961738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4dbeb-a223-4f72-88f5-d4a5a64b21a6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:22.999389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ffac6b-3016-4fa5-9533-781d98be63bf None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:23.001619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.002395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.002741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.003082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.004087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:23.004553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.006084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.010711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:23.021750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 485/973] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:23.027624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:23.042586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.043280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.043562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.043833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.044523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.046354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.063453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.sql.core [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:29:23.063453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 23:29:23.063453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [parameters: {'user_id': 'f070745af3a1455894b8f3ebe2b41e61', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 23:29:23.063453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81694) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 23:29:23.072667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:29:23.073579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application yield resource Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application next(self.gen) Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.rollback() Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.force_reraise() Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise self.value Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application session.commit() Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 29 23:29:23.074563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._prepare_impl() Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.session.flush() Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._flush(objects) Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application compat.raise_( Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application flush_context.execute() Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rec.execute(self) Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 29 23:29:23.076040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 29 23:29:23.076939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result = self._query(query) Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application conn.query(q) Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application result.read() Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 29 23:29:23.079011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f070745af3a1455894b8f3ebe2b41e61', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:23.081163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 29 23:29:23.083182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 489/974] 10.222.0.67 () {60 vars in 1131 bytes} [Mon Aug 29 23:29:22 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:23.088669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:23.193183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7954f-c612-412b-9daa-44b5e246233b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:23.226778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410867b-b0a7-4d1b-9607-8d239118df0e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:23.229543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.230735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.230735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.230735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.238533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.239993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:23.252495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:23.253557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:23.254498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:23.258779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 486/975] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:23.259812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:23.273153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:23.278636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.279543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.280405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.281191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.291712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.294490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:23.310042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:23.311053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 29 23:29:23.312010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:23.315298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 490/976] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:23.320806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:23.354614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:23.384151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ccc3d-6114-4f0b-acca-bb4df2a6323c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:23.425373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.426208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.426585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.426957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.427778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:23.428179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.429885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaddb7-fc3c-410a-9215-90e3dd31125d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.444346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473caa9-9229-476b-a7ee-ab8d78c94253 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:23.449846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 487/977] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:23.451485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f855b-b59a-47ee-9fae-cf73c23266ab None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.451942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f855b-b59a-47ee-9fae-cf73c23266ab None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.452316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f855b-b59a-47ee-9fae-cf73c23266ab None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.458252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 488/978] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:23.459174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f855b-b59a-47ee-9fae-cf73c23266ab None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:23.496555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.497162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.497472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.497743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.498435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:23.498738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.500165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f0c0e-2d68-4abe-bc0c-41ec5b33b7a3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.551433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 491/979] 10.222.0.67 () {56 vars in 1101 bytes} [Mon Aug 29 23:29:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:23.552933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89021-c8a6-408b-9c3c-d276271a1b97 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.553217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89021-c8a6-408b-9c3c-d276271a1b97 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.553504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f89021-c8a6-408b-9c3c-d276271a1b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.587928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:23.613444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-27f89021-c8a6-408b-9c3c-d276271a1b97 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:23.615309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-27f89021-c8a6-408b-9c3c-d276271a1b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:23.639373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f855b-b59a-47ee-9fae-cf73c23266ab None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:23.714540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:23.715152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:23.715431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:23.715703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:23.716549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] RBAC: Adding query filter params (role.id=7be9601dde0a47e19ed4924d863b92e8, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=0b901bb69e1941158bc783a5f4c34256) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:23.716858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:23.719785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:23.732087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 489/980] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:23 2022] GET /identity/v3/role_assignments?user.id=0b901bb69e1941158bc783a5f4c34256&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=7be9601dde0a47e19ed4924d863b92e8 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:23.759006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 492/981] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:24.040160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:24.131987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4564d-2114-4586-a817-984686a4cae7 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:24.132552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4564d-2114-4586-a817-984686a4cae7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:24.132552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4564d-2114-4586-a817-984686a4cae7 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:24.134115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 493/982] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:24.138931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:24.139219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:24.139502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:24.145335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ddada-4888-4c82-b23c-f368f4e16f3a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:24.160821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:24.162070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:24.177755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:24.184250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:24.189884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:24.190607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:24.190977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:24.191321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:24.192045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:24.193503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:24.209913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 490/983] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:24 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:24.249094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 494/984] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:24.517595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:24.621758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878f5c1-14c9-44ec-8bc5-804016d3385c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:24.656787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:24.657468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:24.657742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:24.657997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:24.658585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:24.659973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:24.670348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:24.671369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:24.672398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 491/985] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:24.676594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:24.779554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ee4b9-fd0d-4473-b680-802a0a0bc0af None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:24.814340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:24.814941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:24.815215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:24.815481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:24.816103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:24.816402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:24.817797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:24.822910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 495/986] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:24.828629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:24.893101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:24.940858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbda6f1-fd28-4955-b4c6-9c4b62aee300 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:24.976152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:24.976763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:24.977041 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:24.977313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:24.978033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:24.978338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:24.980265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:24.995027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 492/987] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:24.996812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:25.010697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:25.106559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93275d80-2419-45e1-a5f4-92c1fb5c746c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:25.143205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:25.143835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:25.144067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:25.144338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:25.145045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] RBAC: Adding query filter params (interface=admin, service_id=c237828e4aef4d18a6495553febad2f1, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:25.145366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:25.146924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2c5de-308b-4c9c-9d2a-f941693e8cea None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:25.163374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 496/988] 10.222.0.67 () {56 vars in 1249 bytes} [Mon Aug 29 23:29:24 2022] GET /identity/v3/endpoints?service_id=c237828e4aef4d18a6495553febad2f1&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:25.166455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:25.270818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdc062-9b98-46ef-81d7-73e109414dfa None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:25.291693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:25.308118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07d7b-87a9-4dbd-904f-f181a33cb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:25.308749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07d7b-87a9-4dbd-904f-f181a33cb406 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:25.309030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07d7b-87a9-4dbd-904f-f181a33cb406 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:25.309297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07d7b-87a9-4dbd-904f-f181a33cb406 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:25.309957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07d7b-87a9-4dbd-904f-f181a33cb406 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:25.311371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c07d7b-87a9-4dbd-904f-f181a33cb406 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:25.325399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 493/989] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:25 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:25.713181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb254c2-a85d-48f3-b5ba-7cb0017d5d5b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:25.713587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb254c2-a85d-48f3-b5ba-7cb0017d5d5b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:25.713768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb254c2-a85d-48f3-b5ba-7cb0017d5d5b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:25.715239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 497/990] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:25.720846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a80bf-8828-4dc5-8f91-e0a33ef206c3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:25.721203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a80bf-8828-4dc5-8f91-e0a33ef206c3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:25.721594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a80bf-8828-4dc5-8f91-e0a33ef206c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:25.741964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1e1a80bf-8828-4dc5-8f91-e0a33ef206c3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:25.743257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1e1a80bf-8828-4dc5-8f91-e0a33ef206c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:25.815194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 494/991] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:26.082026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb254c2-a85d-48f3-b5ba-7cb0017d5d5b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.152160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc3f2-b169-46ff-b763-bc1dd0ae835d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.152446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc3f2-b169-46ff-b763-bc1dd0ae835d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.152719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbc3f2-b169-46ff-b763-bc1dd0ae835d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.154257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 495/992] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:26.159792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.160078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.160352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.165452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:26.179342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:26.180534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:26.195534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb254c2-a85d-48f3-b5ba-7cb0017d5d5b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.233273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.234080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.234362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.234634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.235259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.236628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:26.245686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:26.246755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:26.247961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 498/993] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:26.252648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.261571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 496/994] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:26.362213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90051-3f12-4737-b86b-80faff19bbf4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.396898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.397550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.397832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.398103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.398755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] RBAC: Adding query filter params (name=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:26.399057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.400494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.411659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 499/995] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:26.413681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.460224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:26.514641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61683-a28a-4ce0-9e2e-ccfc87fd093f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.552830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.553181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.553861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.554146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.554407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.555052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] RBAC: Adding query filter params (type=image) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:26.555355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.555915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:26.559377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.565582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 497/996] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:26.678489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cedfe-5e88-4adc-bf7d-ed4cab19ce71 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.721366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.722011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.722290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.722565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.723149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.724536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:26.733595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:26.735305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:26.736386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 500/997] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:26.740857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.850712 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f4540-e992-4907-b11e-b041f8144c0a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:26.860527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:26.892874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:26.893538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:26.893820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:26.894092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:26.894732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:26.895040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:26.896410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:26.906268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 498/998] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:26.907791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:26.977370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:27.014995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90f30-fdf6-48e1-902c-74c24ec5824e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.050166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.050770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.051051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.051381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.052010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:27.052313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.053706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.064125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 501/999] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:27.065706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.183295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bbd5d-59a0-4bc6-bca7-54c042b32109 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.219338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.219705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.219971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.220237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.220939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] RBAC: Adding query filter params (interface=public, service_id=221f6f928b894c2a8d2296038b1b0caa, region_id=RegionOne) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:27.221241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.222630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcbd6e-37f3-4523-bdc1-eb569cbccb18 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.228285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 499/1000] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:29:27 2022] GET /identity/v3/endpoints?service_id=221f6f928b894c2a8d2296038b1b0caa&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:27.233690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.260455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbd97-1e52-45c5-90be-cecb5784bf76 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.260742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbd97-1e52-45c5-90be-cecb5784bf76 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.261017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbd97-1e52-45c5-90be-cecb5784bf76 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.262370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 500/1001] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:27.267130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.267409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.267684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.285896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:27.287003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:27.317309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:27.342998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6f645-72df-4b85-a974-ef22f16b3b9a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.363084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 501/1002] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:27.374657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:27.380989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.381616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.381891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.382157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.382746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.384098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.397653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 502/1003] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:27 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:27.634071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.748241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0d227-c1d8-430e-8527-af3c293af052 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.784460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.785541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.786052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.786520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.787321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.788874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:27.797933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:27.798927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 29 23:29:27.799770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:27.801431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 502/1004] 10.222.0.67 () {56 vars in 1126 bytes} [Mon Aug 29 23:29:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:27.806511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.911203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b553f6-d48a-4494-a4f7-9fa5cacb8d47 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:27.944530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:27.945132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:27.945430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:27.945701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:27.946314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:27.946613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:27.948020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:27.957881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 503/1005] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:27.959163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:27.991046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:28.063446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b9331-2ef8-465b-b71b-bc72e18a73b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:28.099240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:28.100132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.100586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.101053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.101932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:28.102428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:28.103955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834b173-1434-412c-8b20-0c78ef9a14d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:28.109218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 503/1006] 10.222.0.67 () {56 vars in 1122 bytes} [Mon Aug 29 23:29:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:28.114664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.185827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:28.230784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed685fc2-a7e9-4d6f-978d-f627257ae5c4 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:28.265304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c6748-47d7-4bff-a6b9-646d40fa424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:28.266619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c6748-47d7-4bff-a6b9-646d40fa424d None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.266933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c6748-47d7-4bff-a6b9-646d40fa424d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.267195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c6748-47d7-4bff-a6b9-646d40fa424d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.267872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c6748-47d7-4bff-a6b9-646d40fa424d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:28.269231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c6748-47d7-4bff-a6b9-646d40fa424d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:28.293394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 504/1007] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:28.523767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbe780-37c5-482e-bbf6-f2a0fa204f81 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.524300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbe780-37c5-482e-bbf6-f2a0fa204f81 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.524300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bbe780-37c5-482e-bbf6-f2a0fa204f81 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.525719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 504/1008] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:28.530959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa2a94-8734-4b3f-add9-09be9579b912 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:28.531245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa2a94-8734-4b3f-add9-09be9579b912 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:28.531558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa2a94-8734-4b3f-add9-09be9579b912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:28.550335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-40fa2a94-8734-4b3f-add9-09be9579b912 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:28.551525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-40fa2a94-8734-4b3f-add9-09be9579b912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:28.625937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 505/1009] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:28.894433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbe780-37c5-482e-bbf6-f2a0fa204f81 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:28.991404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:29.001024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bbe780-37c5-482e-bbf6-f2a0fa204f81 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:29.035624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b6e3a-727f-4807-a5f2-59eca5996fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:29.036229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6e3a-727f-4807-a5f2-59eca5996fac None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.036506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6e3a-727f-4807-a5f2-59eca5996fac None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.036775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b6e3a-727f-4807-a5f2-59eca5996fac None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.037446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b6e3a-727f-4807-a5f2-59eca5996fac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:29.038810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b6e3a-727f-4807-a5f2-59eca5996fac None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:29.068676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 505/1010] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:28 2022] POST /identity/v3/services => generated 242 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:29.334706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613875f0-59b1-45ee-89e7-b9b5dfef1532 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.335696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613875f0-59b1-45ee-89e7-b9b5dfef1532 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.335696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613875f0-59b1-45ee-89e7-b9b5dfef1532 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.338164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 506/1011] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:29.345896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.346313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.346720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.372149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:29.373825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:29.456433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 506/1012] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:29 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:29.735448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613875f0-59b1-45ee-89e7-b9b5dfef1532 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:29.785675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:29.847322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613875f0-59b1-45ee-89e7-b9b5dfef1532 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:29.883005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:29.883633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:29.887364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:29.887364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:29.887364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:29.887364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:29.896747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:29.897827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:29.898674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 507/1013] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:29.905497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:29.990685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:30.012259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda3956-74f3-4541-8935-7247b22c4294 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:30.047102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:30.047723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.051264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.051264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.051264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:30.051264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:30.051264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782b161-c84a-45cc-bda7-3eb0cb14de4c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:30.061142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 507/1014] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:30.062426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:30.175226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d692aaf-76f6-4ee9-855a-33ba538738d6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:30.185432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:30.215089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:30.215749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.216032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.216302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.216940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:30.217242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:30.218653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:30.224266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fb63-31fa-4002-9ffd-1d3e0511effd None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.224809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fb63-31fa-4002-9ffd-1d3e0511effd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.224950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 508/1015] 10.222.0.67 () {56 vars in 1112 bytes} [Mon Aug 29 23:29:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:30.225060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4fb63-31fa-4002-9ffd-1d3e0511effd None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.226534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 508/1016] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:30.230129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:30.234736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.234736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.234995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.253006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:30.254153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:30.326562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 509/1017] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:30 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:30.334990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3784c9-d712-4a8c-9522-f8bfbc167ddc None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:30.369777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:30.370383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.370665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.370944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.371677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:30.373044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:30.395117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 509/1018] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:30 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:30.599919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:30.682291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:30.709971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61627eae-35e4-4a84-97c5-ec8d5a1b87b8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:30.756221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d777-9071-485c-a62c-93eb7bac3551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:30.756855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d777-9071-485c-a62c-93eb7bac3551 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.757134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d777-9071-485c-a62c-93eb7bac3551 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.757436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d777-9071-485c-a62c-93eb7bac3551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.758810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d777-9071-485c-a62c-93eb7bac3551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:30.760246 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79d777-9071-485c-a62c-93eb7bac3551 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:30.762076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 510/1019] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:30.767886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:30.798626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:30.875797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de901d-4a08-474a-b5e4-195c955b1272 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:30.912185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e4df0-79b7-4e25-ad95-ed9837835d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:30.912819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4df0-79b7-4e25-ad95-ed9837835d98 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:30.913101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4df0-79b7-4e25-ad95-ed9837835d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:30.913401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e4df0-79b7-4e25-ad95-ed9837835d98 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:30.914059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e4df0-79b7-4e25-ad95-ed9837835d98 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:30.915502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e4df0-79b7-4e25-ad95-ed9837835d98 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:30.946653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 510/1020] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:30 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:31.040383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094436df-c983-42fc-afc8-82a90d84e8f7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:31.040912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094436df-c983-42fc-afc8-82a90d84e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:31.040912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094436df-c983-42fc-afc8-82a90d84e8f7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:31.042493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 511/1021] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:31.048685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:31.049002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:31.049234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:31.068632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:31.069888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:31.143395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 511/1022] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:31.427684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094436df-c983-42fc-afc8-82a90d84e8f7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:31.535016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094436df-c983-42fc-afc8-82a90d84e8f7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:31.569546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:31.570170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:31.570445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:31.570713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:31.571285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:31.572636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:31.581826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:31.582813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:31.583671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:31.585702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 512/1023] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Aug 29 23:29:31 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:31.589152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:31.603877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:31.704868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a65b2-1f51-4bce-8458-d7a052977288 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:31.739296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:31.739870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:31.740096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:31.740361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:31.740982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] RBAC: Adding query filter params (name=image) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:31.741277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:31.742684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:31.754707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 512/1024] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:31.756318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:31.759234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:31.860850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856df59-0c30-4560-a9e2-9edff9b9f2c2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:31.899038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:31.899653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:31.899929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:31.900196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:31.900828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] RBAC: Adding query filter params (type=image) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:31.901130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:31.902519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:31.912281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 513/1025] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:31.913965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:31.996445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:32.028118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b84343-ae42-4ebd-a4be-057801fbeffe None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:32.068282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:32.068893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.069176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.069508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:32.070207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] RBAC: Adding query filter params (interface=public, service_id=8efedd09ce744b02a0740b45a023d06a, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:32.070514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:32.071887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8a66-fe84-4164-b4bd-ded003fcc7d9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:32.082620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 513/1026] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:29:31 2022] GET /identity/v3/endpoints?service_id=8efedd09ce744b02a0740b45a023d06a&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:32.083976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:32.155538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:32.194496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a3b02-5186-4d4e-b748-a069a495033e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:32.229826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ad869-d4c2-4304-a1c0-5351ea1193ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:32.230434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad869-d4c2-4304-a1c0-5351ea1193ea None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.230710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad869-d4c2-4304-a1c0-5351ea1193ea None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.230980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ad869-d4c2-4304-a1c0-5351ea1193ea None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:32.231581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad869-d4c2-4304-a1c0-5351ea1193ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:32.232937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ad869-d4c2-4304-a1c0-5351ea1193ea None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:32.245430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 514/1027] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:29:32 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:29:32.470072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d0eb-d398-4c09-9c7a-bc173eb3ca40 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.470449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d0eb-d398-4c09-9c7a-bc173eb3ca40 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.470656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1d0eb-d398-4c09-9c7a-bc173eb3ca40 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:32.472144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 514/1028] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:32.477160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548de0b-4f88-42be-bfbb-06cbcccec934 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.477486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548de0b-4f88-42be-bfbb-06cbcccec934 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.477759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548de0b-4f88-42be-bfbb-06cbcccec934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:32.497052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8548de0b-4f88-42be-bfbb-06cbcccec934 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:32.498269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8548de0b-4f88-42be-bfbb-06cbcccec934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:32.569261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 515/1029] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:32.843140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d0eb-d398-4c09-9c7a-bc173eb3ca40 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:32.926047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9363e-2e6f-48e0-98a2-191b3d8af99e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.926334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9363e-2e6f-48e0-98a2-191b3d8af99e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.926609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9363e-2e6f-48e0-98a2-191b3d8af99e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:32.928182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 516/1030] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:32.932971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.933256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.933557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:32.951404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:32.952589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:32.956186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1d0eb-d398-4c09-9c7a-bc173eb3ca40 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:32.991910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:32.992532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:32.992811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:32.993082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.000616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:33.006092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:33.010861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:33.011842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:33.012693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:33.014579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:33.017524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 515/1031] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Aug 29 23:29:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:33.018624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.033680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 517/1032] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:33.123781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d166-2869-4cd4-aec6-5bfae69b92f9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.165601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.166214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.166493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.166765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.167438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:33.167738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.169109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.182490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 516/1033] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:33.183962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.291429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4de4-82b6-4d61-a979-af1be59c86f9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.296001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.333771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.334413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.334690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.334958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.346230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.347930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:33.369995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:33.371044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:33.372138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:33.372138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:33.372138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:33.372138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 518/1034] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:33.374493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:33.378921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.425568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1d654-5d39-4eed-9ba9-1ce3516b5ab2 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.426651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:33.464533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.465163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.465486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.465767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.466865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.468318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.469947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 517/1035] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:33.475702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.488766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06f988-4676-4859-ad1b-0870f5618aa9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.527324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.527944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.528216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.528490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.529141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:33.529479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.530857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.543231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 519/1036] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:33.548883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.585163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e7c32-46a4-46ac-8c7a-29e39e649b41 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.614247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:33.625658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.626199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.626478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.626748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.627413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.628905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.655070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 518/1037] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:29:33 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:33.665176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e683b-2142-4b28-b874-f2ce12842d1d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.668304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:33.711203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.711850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.712130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.712646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.721601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.723081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:33.737996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:33.739062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:33.745020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 520/1038] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:33.745793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:33.862239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06519873-7e56-4878-91ee-c2e8d066eda7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:33.900683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:33.901219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:33.901568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:33.901858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:33.902591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:33.902897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:33.904331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74d9e6-dc00-45a2-9984-56d37c87058f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:33.923071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 519/1039] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:33.928622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.030698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5dbe94-cc72-4371-9cb1-cfbda9ba64bf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.065977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.066582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.066860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.067130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.098047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.137909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.139359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.158855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8533cc-b557-4c7c-8167-8eb3dfdf2ad4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.159066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8533cc-b557-4c7c-8167-8eb3dfdf2ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.159337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8533cc-b557-4c7c-8167-8eb3dfdf2ad4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.160942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 520/1040] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:34.165645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.166158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.166631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.187372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:34.188622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:34.227711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.261516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 521/1041] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:33 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:34.264679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.265045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 521/1042] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:34.327040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.369578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58127-e593-4ee1-858b-85062d495075 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.404141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.404759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.405032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.405295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.416154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.417626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:34.433184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:34.434290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:34.435188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:34.435188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:34.435188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:34.435188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 522/1043] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:34.440184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.534232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.542187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bc614-b209-46bc-af1b-f15dd8fd94f4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.578748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.579357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.579639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.579907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.580552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:34.580845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.582267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.599175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 522/1044] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:34.600928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.633914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.643707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed222d3-a829-4331-adb7-b1dcc1f9d83b None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.658892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.680511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.681063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.681340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.681638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] PATH_INFO: `/v3/services/image` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.682223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.683598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:34.694535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:34.696114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 29 23:29:34.696983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:34.701522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 523/1045] 10.222.0.67 () {56 vars in 1105 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:34.702930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.717526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a442dfc7-d382-4d41-9197-8317b51e84f6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.752318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.752948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.753227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.753528 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.760499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.761991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:34.773810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:34.774742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:34.775969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 523/1046] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:34.780631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.825631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8037-d5f2-4bb3-a70a-33234399cf6f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.864428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.865404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.865836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.866381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.867016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:34.867323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.868808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.874337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 524/1047] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:34.880232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.883774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.890431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29317cfc-5cde-4fb7-93ff-d5255d4eb1b8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:34.931357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:34.931885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:34.932165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:34.932440 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:34.933127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:34.933459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:34.934416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:34.934897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:34.947938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 524/1048] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:34.954404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:34.998153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985cc0b-ff15-46ad-a616-0506d9b0eae1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:35.036301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:35.036908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:35.037195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:35.037497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:35.038132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:35.038434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:35.039800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:35.044754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 525/1049] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:35.050740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:35.063054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90ee8c-931a-475f-bf41-4eeb6e22b5d3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:35.100763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:35.101399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:35.101795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:35.102068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:35.102785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] RBAC: Adding query filter params (role.id=7be9601dde0a47e19ed4924d863b92e8, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=09019a1191eb4b4194c245dff90ef942) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:35.103198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:35.104623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068920b-2db7-4dd4-aa1a-34763f662191 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:35.110886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 525/1050] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:34 2022] GET /identity/v3/role_assignments?user.id=09019a1191eb4b4194c245dff90ef942&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=7be9601dde0a47e19ed4924d863b92e8 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:35.174797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1dcfc-f257-416a-8b9a-5659eff2eba1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:35.185275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:35.217296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0728778-06b8-4edd-89fd-cd448d2d0bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:35.217961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0728778-06b8-4edd-89fd-cd448d2d0bbf None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:35.218242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0728778-06b8-4edd-89fd-cd448d2d0bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:35.218515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0728778-06b8-4edd-89fd-cd448d2d0bbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:35.219345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0728778-06b8-4edd-89fd-cd448d2d0bbf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:35.220744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0728778-06b8-4edd-89fd-cd448d2d0bbf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:35.246801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 526/1051] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:29:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:29:35.663533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67498530-2ce2-4072-a0a3-c149a98011b4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:35.663947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67498530-2ce2-4072-a0a3-c149a98011b4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:35.664129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67498530-2ce2-4072-a0a3-c149a98011b4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:35.665723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 526/1052] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:35.673121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:35.673643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:35.673766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:35.692879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:35.694118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:35.777404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 527/1053] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:36.045881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67498530-2ce2-4072-a0a3-c149a98011b4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:36.064155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:36.159678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67498530-2ce2-4072-a0a3-c149a98011b4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:36.196132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:36.196758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:36.197036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:36.197303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:36.208418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:36.213447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:36.214474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:36.215319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 527/1054] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:36.221234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:36.312721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:36.327063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a10dc-ab0e-4df5-8984-b0204bab0f6f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:36.366787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:36.367454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:36.367736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:36.368006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:36.368674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:36.368975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:36.370385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:36.379676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 528/1055] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:36.385233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:36.466624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:36.491435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aae410-ab12-46af-bb47-a15de65e22e7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:36.527500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:36.528126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:36.528403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:36.528675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] PATH_INFO: `/v3/users/8d4ea9bea7a34d168adbf70857fecee0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:36.542144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] RBAC: Authorizing `identity:get_user(user_id=8d4ea9bea7a34d168adbf70857fecee0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:36.543585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:36.545554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 528/1056] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:36 2022] GET /identity/v3/users/8d4ea9bea7a34d168adbf70857fecee0 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:36.551144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:36.654829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6aa1bc-6661-4d58-9bda-5a6e4cc21e32 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:36.690020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9e32f-4e69-4909-b31a-319237b57b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:36.690683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9e32f-4e69-4909-b31a-319237b57b41 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:36.690894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9e32f-4e69-4909-b31a-319237b57b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:36.691158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9e32f-4e69-4909-b31a-319237b57b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:36.713078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:36.766949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9e32f-4e69-4909-b31a-319237b57b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:36.768462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b9e32f-4e69-4909-b31a-319237b57b41 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:36.875606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 529/1057] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:36.877570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:36.984681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6950ce3-54d6-4384-919f-99bb7b462f5a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:37.020251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:37.020884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.021161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.021458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.022577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] RBAC: Authorizing `identity:get_project(project_id=c08ea0f42d9c40d3b130199b0d047711)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:37.024032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:37.025912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 529/1058] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:29:36 2022] GET /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:37.030564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6341-eb1e-4872-9d9b-1a4f424e1816 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.030850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6341-eb1e-4872-9d9b-1a4f424e1816 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.031120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6341-eb1e-4872-9d9b-1a4f424e1816 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.032779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.033643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 530/1059] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:37.035649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:37.038336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbb2a-ccbb-481a-a8dd-262550190063 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.038710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbb2a-ccbb-481a-a8dd-262550190063 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.038919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbb2a-ccbb-481a-a8dd-262550190063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.057239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3aacbb2a-ccbb-481a-a8dd-262550190063 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:37.058430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3aacbb2a-ccbb-481a-a8dd-262550190063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:37.107975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:37.130613 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 531/1060] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:37.139738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116313d4-2910-4028-9b56-8851fcfaac27 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:37.184006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:37.184613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.184890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.185160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.185914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=c08ea0f42d9c40d3b130199b0d047711, user.id=8d4ea9bea7a34d168adbf70857fecee0) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:37.186221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:37.188216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:37.191574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e56ce-dd85-4b40-8082-79cad6f75772 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.191855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e56ce-dd85-4b40-8082-79cad6f75772 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.192129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e56ce-dd85-4b40-8082-79cad6f75772 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.193607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 532/1061] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:37.195495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 530/1062] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/role_assignments?user.id=8d4ea9bea7a34d168adbf70857fecee0&scope.project.id=c08ea0f42d9c40d3b130199b0d047711&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:37.198419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.198705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.198980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.220445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:37.222520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:37.300238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 533/1063] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:37.403128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.473391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:37.510192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67527ca-1b0a-4018-b874-b8554dd35894 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:37.544908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:37.545558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.545840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.546108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.556633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:37.561309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:37.562284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:37.563842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:37.564522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.565722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 531/1064] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:37.568286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.672112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b48039-3e18-4c48-9f1f-8b6bfa5fac3d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:37.687111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8123d-ce1f-4f0a-ac45-59a3fc5dea71 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:37.698918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:37.700395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:37.714451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:37.715219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.715508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.715778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.716440 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:37.716741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:37.718154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:37.731598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 532/1065] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:37.731765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:37.731765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.731765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.731765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.732680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.802993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:37.804448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:37.833842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76efa7-7ebe-48c1-9c33-496ab227b06d None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:37.868412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:37.869031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:37.869306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:37.869602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:37.881216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:37.882719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:37.898089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:37.899146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:37.900254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:37.900254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:37.900254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:37.900254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 533/1066] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:37.904933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.919522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 534/1067] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:37.920604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:37.932771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:37.948016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:38.019095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969bc24-aa2c-44cb-9bf5-732d6e773d2a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.031666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641631-82c7-41b7-863d-4be98174ce23 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.063557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.064340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.064710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.065081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.065933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:38.066522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.068769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.077658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.079052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.079599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.079872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.082914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 534/1068] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:38.088602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:38.092682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.094304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:38.110196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:38.111202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:38.112730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:38.112730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:38.112730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:38.112730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 535/1069] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:38.117106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:38.189982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:38.208272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:38.211855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab360b-4983-4f41-8927-e6af3a732c43 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.231014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db64307-f433-4424-bf78-ebd4048c8e07 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.249507 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.250757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.251089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.251356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.259065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.260512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.268091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.268713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.269021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.269296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.269999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:38.270304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.271730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:38.272680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:38.274082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:38.275055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 535/1070] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:38.279826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:38.285945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 536/1071] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:38.399921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7f4a7-8031-456f-8b6e-d17a49d2b129 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.438524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.439133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.439901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.439901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.440383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:38.440756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.442167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.460178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 536/1072] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:38.467597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:38.583789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f502869-8fb4-4248-8b93-5afcc02550be None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.609242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:38.622315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.622943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.623222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.623498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.634262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.635706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:38.650520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:38.651512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:38.652423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:38.652423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:38.652423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:38.652423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 537/1073] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:38.658102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:38.679191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:38.760270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81ac8-7a5b-44c1-b30d-855998524aaa None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.796207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.797427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.797710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.797979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.798619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:38.798917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.800281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.812169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 537/1074] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:38.817946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:38.918906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307d93a-dae6-42fc-805e-9aee670e7da6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:38.952632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:38.953783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:38.954061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:38.954332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:38.961087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:38.962850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-4e316ffb-8103-416b-a0b0-1be1765b73b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:38.974852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:38.975763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:38.976697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 538/1075] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:38.981892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:39.059277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:39.081442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dcb4b-ee80-46ae-b773-996ee7fa5a2b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:39.116583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:39.117188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.117499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.117770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.118135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bb8b-2668-4a05-8084-b36335c7301b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.118423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bb8b-2668-4a05-8084-b36335c7301b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.118530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:39.118750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:39.118852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177bb8b-2668-4a05-8084-b36335c7301b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.120190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:39.120291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 539/1076] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:29:39.125620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.125936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.126217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.133232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 538/1077] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:39.139374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:39.147529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:39.148730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:39.177762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:39.219802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 540/1078] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:39.241563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf58f40-42e1-464d-9d82-dbbaa07d83ec None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:39.277074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:39.277753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.278025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.278299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/09019a1191eb4b4194c245dff90ef942/roles/7be9601dde0a47e19ed4924d863b92e8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.280399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=09019a1191eb4b4194c245dff90ef942, role_id=7be9601dde0a47e19ed4924d863b92e8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:39.282422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:39.291017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:39.297362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 539/1079] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:29:39 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/09019a1191eb4b4194c245dff90ef942/roles/7be9601dde0a47e19ed4924d863b92e8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:29:39.498779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:39.597159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53900e7-5648-40eb-83d9-4a9dade6c516 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:39.631195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:39.631830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.632171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.632449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.643079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:39.647804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:39.648901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:39.649996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:39.654610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 541/1080] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:39.654841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:39.753970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fab4e1-9171-48d4-8b4a-78f7d2544246 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:39.788092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:39.788694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.788972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.789232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.789913 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:39.790209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:39.791561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:39.800314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 540/1081] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:39.806149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:39.831818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:39.907561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235ae8a-78a1-4173-91c6-2d999bb65314 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:39.942116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:39.942729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:39.943003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:39.943268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] PATH_INFO: `/v3/users/8d4ea9bea7a34d168adbf70857fecee0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:39.944372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] RBAC: Authorizing `identity:get_user(user_id=8d4ea9bea7a34d168adbf70857fecee0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:39.945826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:39.947531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 542/1082] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:39 2022] GET /identity/v3/users/8d4ea9bea7a34d168adbf70857fecee0 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:39.953264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:40.012432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:40.052777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ba731-f608-466a-b212-a21e4e8dff1a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:40.086287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc47dd3-e8ad-4f17-8a0b-ecfee2d78f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:40.086905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47dd3-e8ad-4f17-8a0b-ecfee2d78f58 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:40.087186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47dd3-e8ad-4f17-8a0b-ecfee2d78f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:40.087705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc47dd3-e8ad-4f17-8a0b-ecfee2d78f58 None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:40.088814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc47dd3-e8ad-4f17-8a0b-ecfee2d78f58 None admin] RBAC: Authorizing `identity:get_project(project_id=c08ea0f42d9c40d3b130199b0d047711)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:40.090281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc47dd3-e8ad-4f17-8a0b-ecfee2d78f58 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:40.091912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 541/1083] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:29:39 2022] GET /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:40.098363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:40.190939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:40.199926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e80f-373c-49a7-9338-8b6be471d2ff None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:40.234055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc0db-e638-484f-a442-ccd7962d56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:40.235307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc0db-e638-484f-a442-ccd7962d56a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:40.235588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc0db-e638-484f-a442-ccd7962d56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:40.235863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc0db-e638-484f-a442-ccd7962d56a0 None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711/users/8d4ea9bea7a34d168adbf70857fecee0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:40.237849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc0db-e638-484f-a442-ccd7962d56a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c08ea0f42d9c40d3b130199b0d047711, user_id=8d4ea9bea7a34d168adbf70857fecee0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:40.239284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc0db-e638-484f-a442-ccd7962d56a0 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:40.252147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 543/1084] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:29:40 2022] PUT /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711/users/8d4ea9bea7a34d168adbf70857fecee0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:41.207080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971281-b14b-45c7-8578-3fe749c1b2e4 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.207080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971281-b14b-45c7-8578-3fe749c1b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.207810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971281-b14b-45c7-8578-3fe749c1b2e4 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.208494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 542/1085] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:41.214017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.214450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.214634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.232496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:41.233718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:41.300397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 544/1086] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:41.584777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a971281-b14b-45c7-8578-3fe749c1b2e4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:41.688469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a971281-b14b-45c7-8578-3fe749c1b2e4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:41.714285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:41.723857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:41.724478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.724756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.725026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.736097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:41.740822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:41.741946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:41.744224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 543/1087] 10.222.0.67 () {56 vars in 1120 bytes} [Mon Aug 29 23:29:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:41.749910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:41.831591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:41.850965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00341de-52cd-49af-935f-40e3416ba2a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:41.894457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:41.895066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:41.895344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:41.895614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:41.896285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:41.896585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:41.897994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:41.906675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 545/1088] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:29:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:41.912388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.009569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0842-e72d-46e0-b5b1-01844866efa7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.042916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.043532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.043807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.044077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.054425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.055863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-97bd81da-7148-4e81-b4b8-5aec8d17338c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:42.069642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:42.070757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:42.072113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:42.072113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:42.072113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:42.072113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 544/1089] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:29:42.076539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.178499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e8b00-2e06-4db6-8460-c486c7bce24b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.178865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e8b00-2e06-4db6-8460-c486c7bce24b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.179138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e8b00-2e06-4db6-8460-c486c7bce24b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.180498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 545/1090] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:42.180724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d645a8-26fb-4e2c-a838-2bd16c10bd53 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.185616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.185903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.186180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.206727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:42.207929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:42.216368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.216970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.217250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.217549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.218189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:42.219075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.220447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.232230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 546/1091] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:42.237840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.241243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.244323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.280269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 546/1092] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:29:42.339499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f4401-f14d-4eb8-b389-6bf2bd920359 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.372900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.373558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.373836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.374105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.381622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.383054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:29:42.395013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:42.396146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:42.397152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 547/1093] 10.222.0.67 () {56 vars in 1093 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:42.401835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.497839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c84dce-9b24-4385-8ec6-3e92583f73ea None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.531093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.531760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.531948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.532213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.532924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:42.533221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.534660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.547333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.551441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 547/1094] 10.222.0.67 () {56 vars in 1133 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:42.556806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.585022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.612599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.652653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9a0c7-799f-4c85-a3a2-077bf946bbae None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.658722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0d67b-7c4f-4cee-8a7e-dcf1a69b0257 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.686553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.687676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.687968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.688247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.692815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.693448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.693729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.694002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.699074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:29:42.704306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:42.705567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:29:42.706432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 548/1095] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:42.711270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.765456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.766935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.794088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.814264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580734b-6a6b-406a-b14a-04525bcb0037 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.838102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:42.849311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:42.849947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:42.850227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:42.850497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:42.851156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:42.851457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:42.852816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:42.863100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 549/1096] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:42.868912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.876299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 548/1097] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:29:42.877297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:42.969525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65adf0-1932-4d57-8728-e0a3e0fd6c5f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:42.974935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e6f14-2c0c-44e2-b594-ccbc5557f767 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.003332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.009489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.010512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.011046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.011437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] PATH_INFO: `/v3/users/8d4ea9bea7a34d168adbf70857fecee0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.013038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] RBAC: Authorizing `identity:get_user(user_id=8d4ea9bea7a34d168adbf70857fecee0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.015060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.016219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.016847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.017125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.017424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.022592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 550/1098] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/users/8d4ea9bea7a34d168adbf70857fecee0 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:43.023884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.032187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.033682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:29:43.049812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:43.050936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:29:43.052036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:29:43.052036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:29:43.052036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:43.052036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 549/1099] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:43.057020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.088985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.135446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24122751-53ad-4d60-984f-926976dcd90c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.164303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f0e8c-1b5e-48f4-ace3-f6e220bd7b29 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.171633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.172773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.173129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.173426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.199267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.199861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.200140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.200404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.201031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:43.201324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.202710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.214552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 550/1100] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:43.220862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.246109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.247573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.262334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.303487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.326999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535b29c-9d9d-4864-abae-7c7cd92e2503 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.350145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 551/1101] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 29 23:29:43.356086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.363871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.364519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.364797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.365066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.371705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.373144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:29:43.384011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:29:43.385231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:29:43.386597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 551/1102] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:29:43.390986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.460337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35dc35e-25e7-4884-b2bf-7bef2f28d531 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.489689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.493248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b7a80-0d1d-4a89-aa51-773084d82239 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.494689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.495312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.495585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.495851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.496956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] RBAC: Authorizing `identity:get_project(project_id=c08ea0f42d9c40d3b130199b0d047711)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.498404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.500085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 552/1103] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:43.506031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.530241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:43.532661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.533181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.533466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.533754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.534420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:43.534725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.536164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.548275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 552/1104] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:43.554425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:43.607947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa48eb-370e-4cd3-87a6-853c86407860 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.642521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.643113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.643725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.643725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.644354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=c08ea0f42d9c40d3b130199b0d047711, user.id=8d4ea9bea7a34d168adbf70857fecee0) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:43.644662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.646133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c472cc-17bf-4884-9c0d-1a7e4bb3cd4b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.651790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 553/1105] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/role_assignments?user.id=8d4ea9bea7a34d168adbf70857fecee0&scope.project.id=c08ea0f42d9c40d3b130199b0d047711&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:43.655525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21f2a4-8fde-46d3-b7bf-23760481d6a3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:43.695792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:43.696412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:43.696691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:43.696959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:43.697745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] RBAC: Adding query filter params (role.id=7be9601dde0a47e19ed4924d863b92e8, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=09019a1191eb4b4194c245dff90ef942) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:43.698056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:43.699545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b72e23-2653-4e56-9028-4d7fbf195115 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:43.706862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 553/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:43 2022] GET /identity/v3/role_assignments?user.id=09019a1191eb4b4194c245dff90ef942&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=7be9601dde0a47e19ed4924d863b92e8 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:29:45.603633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d570b-2035-4909-ba6c-1b33a6c1501a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:45.604159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d570b-2035-4909-ba6c-1b33a6c1501a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:45.604159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d570b-2035-4909-ba6c-1b33a6c1501a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:45.605460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 554/1107] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:45.610626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:45.611076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:45.611172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:45.630462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:45.631640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:45.649517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:45.697875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 554/1108] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:45.964114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d570b-2035-4909-ba6c-1b33a6c1501a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:46.049086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:46.065458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d570b-2035-4909-ba6c-1b33a6c1501a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:46.099158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74386ad-9b56-4a4c-a572-a0650d71ab41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:46.099770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74386ad-9b56-4a4c-a572-a0650d71ab41 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:46.100050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74386ad-9b56-4a4c-a572-a0650d71ab41 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:46.100317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74386ad-9b56-4a4c-a572-a0650d71ab41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:46.101442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74386ad-9b56-4a4c-a572-a0650d71ab41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:46.102865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74386ad-9b56-4a4c-a572-a0650d71ab41 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:46.104418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 555/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:46.110703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:46.211031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6c3ec-9210-4ba8-b17b-368a7619d5ca None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:46.244633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdddf5-5702-4de5-9d5f-c0373afe6886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:46.245158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdddf5-5702-4de5-9d5f-c0373afe6886 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:46.245462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdddf5-5702-4de5-9d5f-c0373afe6886 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:46.245731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdddf5-5702-4de5-9d5f-c0373afe6886 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:46.246375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdddf5-5702-4de5-9d5f-c0373afe6886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:46.247792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdddf5-5702-4de5-9d5f-c0373afe6886 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:46.268328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 555/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:29:46 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:48.234361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f238b54-b49f-4ca3-8471-94c97007b281 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:48.234909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f238b54-b49f-4ca3-8471-94c97007b281 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:48.234909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f238b54-b49f-4ca3-8471-94c97007b281 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:48.236226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 556/1111] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:48.241420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:48.241858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:48.241977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:48.259748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:48.260938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:48.263705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:48.327368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 556/1112] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:48.603096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f238b54-b49f-4ca3-8471-94c97007b281 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:48.705416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f238b54-b49f-4ca3-8471-94c97007b281 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:48.738906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:48.739520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:48.739800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:48.740070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] PATH_INFO: `/v3/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:48.741485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] RBAC: Authorizing `identity:get_role(role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:48.742862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:48.744176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 557/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:48 2022] GET /identity/v3/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:48.750663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:48.861692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d3cb2-35e6-45ad-a575-6a19176a1ebb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:48.897063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:48.897714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:48.897991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:48.898258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] PATH_INFO: `/v3/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:48.908446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:48.911775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] RBAC: Authorizing `identity:get_user(user_id=e1fa15bebb4d4cafb748a2a4f3c6d8bc)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:48.913623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:48.915256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 557/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:48 2022] GET /identity/v3/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:48.921142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:48.946662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:49.021418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb18e4-69bd-40fc-8563-e86e353f142d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:49.054915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:49.055511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:49.055791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:49.056061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:49.130789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:49.132155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:49.157715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:49.232530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 558/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:49.239111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:49.337676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b758b5-3aa6-43bf-ad13-c778e96a43e1 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:49.372459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c193b-5863-4cdc-a363-4025f58def50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:49.373077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c193b-5863-4cdc-a363-4025f58def50 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:49.373380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c193b-5863-4cdc-a363-4025f58def50 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:49.373640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c193b-5863-4cdc-a363-4025f58def50 None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:49.374779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c193b-5863-4cdc-a363-4025f58def50 None admin] RBAC: Authorizing `identity:get_project(project_id=c08ea0f42d9c40d3b130199b0d047711)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:49.376206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c193b-5863-4cdc-a363-4025f58def50 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:49.377847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 558/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:29:49 2022] GET /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:49.384114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:49.482187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028e648-45c6-43fc-a121-018cdd835750 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:49.504308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:49.516422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:49.517021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:49.517300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:49.517598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:49.518326 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] RBAC: Adding query filter params (role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=c08ea0f42d9c40d3b130199b0d047711, user.id=e1fa15bebb4d4cafb748a2a4f3c6d8bc) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:49.518627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:49.520052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdfcf1-de35-48e3-bbfd-c553d5cfd6dd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:49.527279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 559/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:49 2022] GET /identity/v3/role_assignments?user.id=e1fa15bebb4d4cafb748a2a4f3c6d8bc&scope.project.id=c08ea0f42d9c40d3b130199b0d047711&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:51.381610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750bdd0-e99f-46b9-a519-b6cccc552c72 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.382160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750bdd0-e99f-46b9-a519-b6cccc552c72 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.382160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750bdd0-e99f-46b9-a519-b6cccc552c72 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.383477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 559/1118] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:51.388522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.388928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.389065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.408044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:51.409148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:51.475332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 560/1119] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:51.754621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750bdd0-e99f-46b9-a519-b6cccc552c72 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.819743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:51.855110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750bdd0-e99f-46b9-a519-b6cccc552c72 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:51.890237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:51.890863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:51.891141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:51.891412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] PATH_INFO: `/v3/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:51.892808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] RBAC: Authorizing `identity:get_role(role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:51.894212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:51.895542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 560/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:51 2022] GET /identity/v3/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:51.901423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:51.999071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11560821-f68b-480b-8a40-de2e7923bd79 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:52.015945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:52.033423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:52.034049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:52.034329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:52.034601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] PATH_INFO: `/v3/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:52.035710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] RBAC: Authorizing `identity:get_user(user_id=e1fa15bebb4d4cafb748a2a4f3c6d8bc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:52.037148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:52.038810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 561/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:51 2022] GET /identity/v3/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:52.044670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:52.142096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb534b9-8b13-4f41-ab03-9985d04d1e2a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:52.176776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c9223-2d0c-4eb8-ba23-81a96decc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:52.177410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9223-2d0c-4eb8-ba23-81a96decc36b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:52.177692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9223-2d0c-4eb8-ba23-81a96decc36b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:52.177962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c9223-2d0c-4eb8-ba23-81a96decc36b None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:52.179066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9223-2d0c-4eb8-ba23-81a96decc36b None admin] RBAC: Authorizing `identity:get_project(project_id=c08ea0f42d9c40d3b130199b0d047711)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:52.180500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c9223-2d0c-4eb8-ba23-81a96decc36b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:52.182152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 561/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:29:52 2022] GET /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:52.188179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:52.286083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769efa8-ca23-4565-93ce-aec38555dc69 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:52.319050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50faa7-eb17-400a-adb8-714f1a7989bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:52.319689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50faa7-eb17-400a-adb8-714f1a7989bd None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:52.319962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50faa7-eb17-400a-adb8-714f1a7989bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:52.320236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50faa7-eb17-400a-adb8-714f1a7989bd None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:52.322340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50faa7-eb17-400a-adb8-714f1a7989bd None admin] RBAC: Authorizing `identity:create_grant(project_id=c08ea0f42d9c40d3b130199b0d047711, user_id=e1fa15bebb4d4cafb748a2a4f3c6d8bc, role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:52.323764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50faa7-eb17-400a-adb8-714f1a7989bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:52.336065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 562/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:29:52 2022] PUT /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:29:54.223827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479adbbf-1039-48fe-8782-d64f8876addb None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:54.224369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479adbbf-1039-48fe-8782-d64f8876addb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:54.224369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479adbbf-1039-48fe-8782-d64f8876addb None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:54.225759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 562/1124] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:54.230972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:54.231406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:54.231499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:54.249425 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:54.250620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:54.290638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:54.318097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 563/1125] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:54.585898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479adbbf-1039-48fe-8782-d64f8876addb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:54.589015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:54.686410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479adbbf-1039-48fe-8782-d64f8876addb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:54.720496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:54.721111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:54.721516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:54.721791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] PATH_INFO: `/v3/roles/4ba86c5e9576490daa6ed99a3bdadfae` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:54.723186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] RBAC: Authorizing `identity:get_role(role_id=4ba86c5e9576490daa6ed99a3bdadfae)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:54.724556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:54.725901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 563/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:54 2022] GET /identity/v3/roles/4ba86c5e9576490daa6ed99a3bdadfae => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:54.731771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:54.828428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb837b1b-b7d2-4574-afab-08f849178b53 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:54.861649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:54.862269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:54.862549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:54.862818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] PATH_INFO: `/v3/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:54.863938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=e1fa15bebb4d4cafb748a2a4f3c6d8bc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:54.865382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:54.866938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 564/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:29:54 2022] GET /identity/v3/users/e1fa15bebb4d4cafb748a2a4f3c6d8bc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:54.872831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:54.941356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:54.971585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd43922-d49b-4c40-b373-c3fab5b7f01b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:55.004893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:55.005511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:55.005788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:55.006058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:55.071031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:55.072484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:55.140644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:55.172470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 564/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:29:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:29:55.178349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:55.221104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:55.276049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312fe42-ef16-4ac4-9d63-be60ac596ff2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:55.309755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ebf08-c5bc-4ce7-b30d-8f8c8ab7a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:55.310369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ebf08-c5bc-4ce7-b30d-8f8c8ab7a2ab None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:55.310644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ebf08-c5bc-4ce7-b30d-8f8c8ab7a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:55.310913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ebf08-c5bc-4ce7-b30d-8f8c8ab7a2ab None admin] PATH_INFO: `/v3/projects/c08ea0f42d9c40d3b130199b0d047711` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:55.312032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ebf08-c5bc-4ce7-b30d-8f8c8ab7a2ab None admin] RBAC: Authorizing `identity:get_project(project_id=c08ea0f42d9c40d3b130199b0d047711)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:55.313479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ebf08-c5bc-4ce7-b30d-8f8c8ab7a2ab None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:55.315080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 565/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:29:55 2022] GET /identity/v3/projects/c08ea0f42d9c40d3b130199b0d047711 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:55.321234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:55.419605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e40bd-2b07-467d-a6d7-46b5b11e5082 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:55.454035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:55.454637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:55.454916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:55.455185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:55.455903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] RBAC: Adding query filter params (role.id=4ba86c5e9576490daa6ed99a3bdadfae, scope.project.id=c08ea0f42d9c40d3b130199b0d047711, user.id=e1fa15bebb4d4cafb748a2a4f3c6d8bc) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:29:55.456207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:55.457660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a1fc3-4c44-4d06-b226-270e702f6d76 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:55.463677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 565/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:29:55 2022] GET /identity/v3/role_assignments?user.id=e1fa15bebb4d4cafb748a2a4f3c6d8bc&scope.project.id=c08ea0f42d9c40d3b130199b0d047711&role.id=4ba86c5e9576490daa6ed99a3bdadfae => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:57.409829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bb782-c46c-4c2f-8542-fb25fa764d32 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:57.410333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bb782-c46c-4c2f-8542-fb25fa764d32 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:57.410333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bb782-c46c-4c2f-8542-fb25fa764d32 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:57.411625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 566/1131] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:29:57.416701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:57.417135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:57.417229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:57.435658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:29:57.437325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:29:57.463752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:57.503326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 566/1132] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:29:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:29:57.770943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bb782-c46c-4c2f-8542-fb25fa764d32 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:57.871521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bb782-c46c-4c2f-8542-fb25fa764d32 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:57.888541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:29:57.912433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af21bb4-6563-40de-b6e9-5c97e81b2b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:57.913052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21bb4-6563-40de-b6e9-5c97e81b2b55 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:57.913332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21bb4-6563-40de-b6e9-5c97e81b2b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:57.913637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21bb4-6563-40de-b6e9-5c97e81b2b55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:57.914728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af21bb4-6563-40de-b6e9-5c97e81b2b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:57.916147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af21bb4-6563-40de-b6e9-5c97e81b2b55 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:57.917725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 567/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:29:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:29:57.924472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:29:58.021794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9dc37-b476-4aa7-8ce1-3edf285f2f59 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:29:58.054961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32f079-f088-4259-9837-99689125975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:29:58.055554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f079-f088-4259-9837-99689125975f None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:58.055835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f079-f088-4259-9837-99689125975f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:58.056106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32f079-f088-4259-9837-99689125975f None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:58.056757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32f079-f088-4259-9837-99689125975f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:29:58.058214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32f079-f088-4259-9837-99689125975f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:29:58.084727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 567/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:29:57 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:29:59.997781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a80d82-8c30-4461-acbc-c1203382d183 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:29:59.998349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a80d82-8c30-4461-acbc-c1203382d183 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:29:59.998349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a80d82-8c30-4461-acbc-c1203382d183 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:29:59.999668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 568/1135] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:00.004863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:00.005308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:00.005549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:00.027052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:00.028224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:00.040554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:00.100672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 568/1136] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:00.390250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a80d82-8c30-4461-acbc-c1203382d183 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:00.502805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a80d82-8c30-4461-acbc-c1203382d183 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:00.537111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fff2fc-7bd5-47f4-ae90-d996af671ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:00.537757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fff2fc-7bd5-47f4-ae90-d996af671ace None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:00.538032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fff2fc-7bd5-47f4-ae90-d996af671ace None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:00.538299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fff2fc-7bd5-47f4-ae90-d996af671ace None admin] PATH_INFO: `/v3/domains/default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:00.539395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fff2fc-7bd5-47f4-ae90-d996af671ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:00.540824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fff2fc-7bd5-47f4-ae90-d996af671ace None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:00.542424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 569/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:00.548326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:00.654377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3567a173-ec17-48fc-a1b6-3b384c156094 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:00.687257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d1fd6-0a3c-4636-82d9-092b2ba236ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:00.687853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d1fd6-0a3c-4636-82d9-092b2ba236ce None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:00.688133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d1fd6-0a3c-4636-82d9-092b2ba236ce None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:00.688403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d1fd6-0a3c-4636-82d9-092b2ba236ce None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:00.689061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d1fd6-0a3c-4636-82d9-092b2ba236ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:00.690526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868d1fd6-0a3c-4636-82d9-092b2ba236ce None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:00.711579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 569/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:30:00 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:02.734974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6652b-48f7-42b0-b91a-cdbd2df7c7a8 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:02.735513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6652b-48f7-42b0-b91a-cdbd2df7c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:02.735513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6652b-48f7-42b0-b91a-cdbd2df7c7a8 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:02.736848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 570/1139] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:02.742076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:02.742509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:02.742602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:02.748765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:02.762370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:02.763544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:02.841594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 570/1140] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:03.111340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6652b-48f7-42b0-b91a-cdbd2df7c7a8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:03.165418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:03.221263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6652b-48f7-42b0-b91a-cdbd2df7c7a8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:03.255130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:03.255742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:03.256020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:03.256303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:03.266295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:30:03.271203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:03.272345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:30:03.273315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 571/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:30:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:30:03.278369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:03.376873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf040e00-cb8e-4ed4-823b-8cebbc72c904 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:03.404774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:03.410642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:03.411236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:03.411511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:03.411778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:03.412431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:03.412730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:03.414120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:03.422689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 571/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:03.430511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:03.529904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d13b0-4288-4ee8-9e81-7e5e0785f47f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:03.537094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:03.564310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:03.564926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:03.565205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:03.565509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] PATH_INFO: `/v3/users/724cf7829c09487a84ba8f4ee35be997` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:03.579057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] RBAC: Authorizing `identity:get_user(user_id=724cf7829c09487a84ba8f4ee35be997)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:03.580499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:03.582114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 572/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:30:03 2022] GET /identity/v3/users/724cf7829c09487a84ba8f4ee35be997 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:03.588321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:03.686862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567a98b-e4a8-4074-b140-9ccbd675abf7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:03.719438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:03.720032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:03.720305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:03.720570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:03.780005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:03.788219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:03.789725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:03.886310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 572/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:30:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:30:03.892515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:03.989008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8a405-c2b2-45dd-bb51-792a40c2116d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:04.021806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67e3b1-0729-42bb-abf8-f7203e0213bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:04.022458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67e3b1-0729-42bb-abf8-f7203e0213bd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:04.022741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67e3b1-0729-42bb-abf8-f7203e0213bd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:04.023021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67e3b1-0729-42bb-abf8-f7203e0213bd None admin] PATH_INFO: `/v3/projects/a4a01868359a471ebe09683a166c448f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:04.024141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67e3b1-0729-42bb-abf8-f7203e0213bd None admin] RBAC: Authorizing `identity:get_project(project_id=a4a01868359a471ebe09683a166c448f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:04.025599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67e3b1-0729-42bb-abf8-f7203e0213bd None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:04.027213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 573/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:30:03 2022] GET /identity/v3/projects/a4a01868359a471ebe09683a166c448f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:04.033531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:04.137308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:04.151940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4223a-2349-4d49-9806-a750b239fe07 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:04.189810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:04.190520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:04.190807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:04.191081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:04.191812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=a4a01868359a471ebe09683a166c448f, user.id=724cf7829c09487a84ba8f4ee35be997) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:04.192129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:04.193609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a702d-d252-4485-bc9e-9a881c058efd None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:04.199588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 573/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:30:04 2022] GET /identity/v3/role_assignments?user.id=724cf7829c09487a84ba8f4ee35be997&scope.project.id=a4a01868359a471ebe09683a166c448f&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:06.060020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be087-3b4d-4fd0-988a-0ba6fa22f81b None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.060587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be087-3b4d-4fd0-988a-0ba6fa22f81b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.060587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9be087-3b4d-4fd0-988a-0ba6fa22f81b None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.061916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 574/1147] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:06.066980 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.067357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.067548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.085736 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:06.086903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:06.151953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 574/1148] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:06.417774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be087-3b4d-4fd0-988a-0ba6fa22f81b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.449761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:06.520607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9be087-3b4d-4fd0-988a-0ba6fa22f81b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:06.559702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:06.560328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.560608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.560877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.571727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:30:06.576448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:06.578248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:30:06.579301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 575/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:30:06.584221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.669231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:06.681371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df081f-2d10-4a17-a829-7bfc785efbe1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:06.715170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:06.715711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.715985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.716246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.716922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:06.717199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:06.718603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:06.727038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 575/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:06.732871 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.825336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:06.834235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a68e6-0ae3-4783-8537-34eec5b18ecd None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:06.867634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:06.868254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:06.868539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:06.868811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] PATH_INFO: `/v3/users/724cf7829c09487a84ba8f4ee35be997` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:06.869929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] RBAC: Authorizing `identity:get_user(user_id=724cf7829c09487a84ba8f4ee35be997)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:06.871360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:06.872921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 576/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:30:06 2022] GET /identity/v3/users/724cf7829c09487a84ba8f4ee35be997 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:06.879700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:06.985407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ea3a7-d589-4efa-8fd3-32b291f33d7f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.018012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c9abc-1294-448f-8b8e-af113bbdeb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.018626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9abc-1294-448f-8b8e-af113bbdeb8a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.018906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9abc-1294-448f-8b8e-af113bbdeb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.019177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c9abc-1294-448f-8b8e-af113bbdeb8a None admin] PATH_INFO: `/v3/projects/a4a01868359a471ebe09683a166c448f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.020284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c9abc-1294-448f-8b8e-af113bbdeb8a None admin] RBAC: Authorizing `identity:get_project(project_id=a4a01868359a471ebe09683a166c448f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.021756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c9abc-1294-448f-8b8e-af113bbdeb8a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.023381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 576/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:30:06 2022] GET /identity/v3/projects/a4a01868359a471ebe09683a166c448f => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:07.029394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:07.128278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399cf085-e509-48e5-8c1c-ae6088ff0199 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:07.162730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934bc8e4-4fb7-404f-a0ea-0e07dac6c0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:07.163376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc8e4-4fb7-404f-a0ea-0e07dac6c0d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:07.163651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc8e4-4fb7-404f-a0ea-0e07dac6c0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:07.163919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934bc8e4-4fb7-404f-a0ea-0e07dac6c0d8 None admin] PATH_INFO: `/v3/projects/a4a01868359a471ebe09683a166c448f/users/724cf7829c09487a84ba8f4ee35be997/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:07.165793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc8e4-4fb7-404f-a0ea-0e07dac6c0d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4a01868359a471ebe09683a166c448f, user_id=724cf7829c09487a84ba8f4ee35be997, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:07.167206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934bc8e4-4fb7-404f-a0ea-0e07dac6c0d8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:07.180992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 577/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:30:07 2022] PUT /identity/v3/projects/a4a01868359a471ebe09683a166c448f/users/724cf7829c09487a84ba8f4ee35be997/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:09.050103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a00a-7a98-4128-b50e-4e88dfa33d31 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:09.050673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a00a-7a98-4128-b50e-4e88dfa33d31 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:09.050673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a00a-7a98-4128-b50e-4e88dfa33d31 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:09.051967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 577/1154] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:09.057126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:09.057626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:09.057730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:09.076295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:09.078022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:09.092721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:09.149494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 578/1155] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:09.414840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5a00a-7a98-4128-b50e-4e88dfa33d31 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:09.437760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:09.525837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5a00a-7a98-4128-b50e-4e88dfa33d31 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:09.559886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:09.560499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:09.561891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:09.561891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:09.571981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:30:09.576631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:09.578299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:30:09.579360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 578/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:30:09.584323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:09.684346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136f4b2-08e6-4fbe-8ca3-01f78d784624 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:09.718408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:09.718999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:09.719276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:09.719543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:09.720196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:09.720493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:09.721887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:09.729840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 579/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:09.736163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:09.817923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:09.839910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d75115-6d37-4aef-962d-81bcc98f064c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:09.885015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:09.885691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:09.885965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:09.886236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] PATH_INFO: `/v3/users/724cf7829c09487a84ba8f4ee35be997` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:09.887498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] RBAC: Authorizing `identity:get_user(user_id=724cf7829c09487a84ba8f4ee35be997)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:09.889007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:09.890729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 579/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:30:09 2022] GET /identity/v3/users/724cf7829c09487a84ba8f4ee35be997 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:09.896940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:09.913646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:10.007290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23e48f-06d2-48d9-b06c-e614895c1f0a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:10.044280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:10.044901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:10.045183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:10.045476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:10.119858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:10.121273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:10.135998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:10.223909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 580/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:30:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:30:10.230066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:10.331860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee620-f906-4faa-a9ec-9554cd2a2b36 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:10.368780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ec16e-1ed1-4293-8de0-7dd1c9638190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:10.369445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ec16e-1ed1-4293-8de0-7dd1c9638190 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:10.369728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ec16e-1ed1-4293-8de0-7dd1c9638190 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:10.370009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ec16e-1ed1-4293-8de0-7dd1c9638190 None admin] PATH_INFO: `/v3/projects/a4a01868359a471ebe09683a166c448f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:10.371157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ec16e-1ed1-4293-8de0-7dd1c9638190 None admin] RBAC: Authorizing `identity:get_project(project_id=a4a01868359a471ebe09683a166c448f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:10.372621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ec16e-1ed1-4293-8de0-7dd1c9638190 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:10.374393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 580/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:30:10 2022] GET /identity/v3/projects/a4a01868359a471ebe09683a166c448f => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:10.380730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:10.481329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa63923-266a-4c19-864a-f098b3b7d6f9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:10.494422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:10.515844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:10.516442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:10.516717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:10.516985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:10.517753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=a4a01868359a471ebe09683a166c448f, user.id=724cf7829c09487a84ba8f4ee35be997) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:10.518059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:10.519481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b3c25-b5cb-4203-aaed-257560ab778d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:10.525081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 581/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:30:10 2022] GET /identity/v3/role_assignments?user.id=724cf7829c09487a84ba8f4ee35be997&scope.project.id=a4a01868359a471ebe09683a166c448f&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:12.451746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58fa5e-aff4-4905-a94f-84210376bb0c None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:12.452861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58fa5e-aff4-4905-a94f-84210376bb0c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:12.452861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58fa5e-aff4-4905-a94f-84210376bb0c None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:12.454186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 581/1162] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:12.459442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:12.459876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:12.459986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:12.478253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:12.479432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:12.549086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 582/1163] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:12.815589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58fa5e-aff4-4905-a94f-84210376bb0c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:12.831529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:12.917169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58fa5e-aff4-4905-a94f-84210376bb0c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:12.950606 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:12.951198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:12.951477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:12.951774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:13.017476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:13.018928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:13.032666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:13.116661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 582/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:30:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:30:13.122661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:13.221102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d7917-3079-4743-b8ef-1916adadf3aa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:13.228404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:13.255619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:13.256241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:13.256518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:13.256787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:13.263339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:13.264808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bbacb044-1693-451d-aa68-984a3c50d4f5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:13.275992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:13.277316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:30:13.278398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 583/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:30:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:30:13.283649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:13.383201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146edb6e-1b53-4404-95c0-f142a540b288 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:13.396966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:13.417819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:13.418422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:13.418707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:13.418973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:13.419607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:13.419908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:13.421904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18aa27-8c16-480d-83d3-7e1570894667 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:13.429121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 583/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Mon Aug 29 23:30:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:15.314596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c9f6-6faa-4a29-bb56-a6bcb2d4c81e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:15.315125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c9f6-6faa-4a29-bb56-a6bcb2d4c81e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:15.315125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463c9f6-6faa-4a29-bb56-a6bcb2d4c81e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:15.316481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 584/1167] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:15.321854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b211d92-a29b-44b3-82b8-26909a6efacc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:15.322270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b211d92-a29b-44b3-82b8-26909a6efacc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:15.322398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b211d92-a29b-44b3-82b8-26909a6efacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:15.341319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8b211d92-a29b-44b3-82b8-26909a6efacc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:15.343237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8b211d92-a29b-44b3-82b8-26909a6efacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:15.413681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 584/1168] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:15.696453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c9f6-6faa-4a29-bb56-a6bcb2d4c81e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:15.817051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463c9f6-6faa-4a29-bb56-a6bcb2d4c81e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:15.850374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d4de5-3207-43a8-ace4-c1504a71dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:15.850976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4de5-3207-43a8-ace4-c1504a71dd04 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:15.851259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4de5-3207-43a8-ace4-c1504a71dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:15.851529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d4de5-3207-43a8-ace4-c1504a71dd04 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:15.852217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d4de5-3207-43a8-ace4-c1504a71dd04 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:15.854173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d4de5-3207-43a8-ace4-c1504a71dd04 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:15.871132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 585/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Mon Aug 29 23:30:15 2022] POST /identity/v3/domains => generated 267 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:17.841231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20907bf0-c73d-40ed-af5a-6d9de14c5b55 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.841862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20907bf0-c73d-40ed-af5a-6d9de14c5b55 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.841862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20907bf0-c73d-40ed-af5a-6d9de14c5b55 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.843676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 585/1170] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:17.848859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:17.849293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:17.849413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:17.869303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:17.870534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:17.897058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:17.947972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 586/1171] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:18.229297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20907bf0-c73d-40ed-af5a-6d9de14c5b55 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.339886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20907bf0-c73d-40ed-af5a-6d9de14c5b55 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.349535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:18.375006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1c724-9df0-4530-b81c-1afdc875a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.375632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1c724-9df0-4530-b81c-1afdc875a436 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.375912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1c724-9df0-4530-b81c-1afdc875a436 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.376184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1c724-9df0-4530-b81c-1afdc875a436 None admin] PATH_INFO: `/v3/domains/1c573bb2acb64a0c909b1b7428013ba9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.386630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1c724-9df0-4530-b81c-1afdc875a436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1c573bb2acb64a0c909b1b7428013ba9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.388076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1c724-9df0-4530-b81c-1afdc875a436 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.390324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 586/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Mon Aug 29 23:30:18 2022] GET /identity/v3/domains/1c573bb2acb64a0c909b1b7428013ba9 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:18.396257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:18.494811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc16ee-1890-4ba6-b306-99181b88b027 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:18.538638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a72b16-b911-4569-adb7-bdecfa4c38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:18.539251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72b16-b911-4569-adb7-bdecfa4c38c3 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:18.539530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72b16-b911-4569-adb7-bdecfa4c38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:18.539802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a72b16-b911-4569-adb7-bdecfa4c38c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:18.540452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72b16-b911-4569-adb7-bdecfa4c38c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:18.541939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a72b16-b911-4569-adb7-bdecfa4c38c3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:18.567967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 587/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:30:18 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:20.532157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2c2f-7861-4ac5-9b17-2980a9537d46 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:20.532706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2c2f-7861-4ac5-9b17-2980a9537d46 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:20.532706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2c2f-7861-4ac5-9b17-2980a9537d46 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:20.534143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 587/1174] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:20.539573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:20.540008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:20.540115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:20.558454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:20.559625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:20.562200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:20.627183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 588/1175] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:20.894224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2c2f-7861-4ac5-9b17-2980a9537d46 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:20.995716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2c2f-7861-4ac5-9b17-2980a9537d46 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.027950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65684255-f217-4309-ab32-fd3ae6fddde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.028567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684255-f217-4309-ab32-fd3ae6fddde8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.028842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684255-f217-4309-ab32-fd3ae6fddde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.029108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65684255-f217-4309-ab32-fd3ae6fddde8 None admin] PATH_INFO: `/v3/domains/1c573bb2acb64a0c909b1b7428013ba9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.030857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65684255-f217-4309-ab32-fd3ae6fddde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1c573bb2acb64a0c909b1b7428013ba9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.032293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65684255-f217-4309-ab32-fd3ae6fddde8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.033889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 588/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Mon Aug 29 23:30:20 2022] GET /identity/v3/domains/1c573bb2acb64a0c909b1b7428013ba9 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:21.039636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:21.138318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c96298-c14e-4da7-aec4-6f63ad62db57 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:21.173676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f411d-d343-4418-8b1e-ba23ddb9075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:21.174285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f411d-d343-4418-8b1e-ba23ddb9075b None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:21.174567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f411d-d343-4418-8b1e-ba23ddb9075b None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:21.174842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f411d-d343-4418-8b1e-ba23ddb9075b None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:21.175496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f411d-d343-4418-8b1e-ba23ddb9075b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:21.176934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f411d-d343-4418-8b1e-ba23ddb9075b None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:21.187088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:21.200164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 589/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:30:21 2022] POST /identity/v3/users => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:30:23.136925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51b58-dff7-418c-bba7-1e42c43cc034 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:23.137509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51b58-dff7-418c-bba7-1e42c43cc034 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:23.137509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51b58-dff7-418c-bba7-1e42c43cc034 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:23.138839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 589/1178] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:23.144793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:23.145257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:23.145415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:23.163647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:23.164823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:23.232013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 590/1179] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:23.500169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51b58-dff7-418c-bba7-1e42c43cc034 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:23.536347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:23.601815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51b58-dff7-418c-bba7-1e42c43cc034 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:23.636868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:23.637524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:23.637804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:23.638072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:23.648254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:30:23.652960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:23.654178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:30:23.655783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 590/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:30:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:30:23.660599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:23.757297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cd42c-42af-4f18-92cc-4fdd861b462d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:23.779815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:23.792514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:23.793123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:23.793424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:23.793695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:23.794350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:23.794647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:23.797697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:23.805753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 591/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:30:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:23.811794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:23.914006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:23.920361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bf3b0-1915-44b2-8ae6-4a3cccb73bc7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:23.956148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:23.956775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:23.957060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:23.957329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] PATH_INFO: `/v3/users/c1e97ee5abe14820a55796dd7610ba44` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:23.971902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e97ee5abe14820a55796dd7610ba44)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:23.973375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:23.979900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 591/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:30:23 2022] GET /identity/v3/users/c1e97ee5abe14820a55796dd7610ba44 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:23.981124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:24.084027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdcc67-f999-467b-a5df-7f8d42dc6cd6 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:24.120113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:24.120716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:24.120987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:24.121250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:24.180449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:24.193916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:24.195366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:24.295996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 592/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:30:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:30:24.301890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:24.398772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3eae7-6a45-4d76-9eb5-d95590f6e5e3 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:24.430796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875f95c-e037-4118-9a70-ebc49de32da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:24.431403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f95c-e037-4118-9a70-ebc49de32da9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:24.431675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f95c-e037-4118-9a70-ebc49de32da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:24.431940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875f95c-e037-4118-9a70-ebc49de32da9 None admin] PATH_INFO: `/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:24.433022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875f95c-e037-4118-9a70-ebc49de32da9 None admin] RBAC: Authorizing `identity:get_project(project_id=c9dccee2d4dd4a5297f94b97a8270a27)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:24.434506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875f95c-e037-4118-9a70-ebc49de32da9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:24.436120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 592/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:30:24 2022] GET /identity/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:24.442885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:24.526424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:24.541449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d148983-5ea3-4f80-b9dc-73f79f4a7485 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:24.585141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:24.585822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:24.586101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:24.586373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:24.587111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=c9dccee2d4dd4a5297f94b97a8270a27, user.id=c1e97ee5abe14820a55796dd7610ba44) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:24.587666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:24.589116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaec1bf-ef0b-4a67-8abb-466b75c645a1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:24.594740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 593/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:30:24 2022] GET /identity/v3/role_assignments?user.id=c1e97ee5abe14820a55796dd7610ba44&scope.project.id=c9dccee2d4dd4a5297f94b97a8270a27&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:26.490810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c2ee-c71a-4467-a576-6ca1f00748a1 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.491307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c2ee-c71a-4467-a576-6ca1f00748a1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.491307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050c2ee-c71a-4467-a576-6ca1f00748a1 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.492596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 593/1186] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:26.497672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:26.498057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:26.498206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:26.516721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:26.517954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:26.585693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 594/1187] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:26.859628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050c2ee-c71a-4467-a576-6ca1f00748a1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:26.883795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:26.966922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050c2ee-c71a-4467-a576-6ca1f00748a1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.000292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.000905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.001180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.001477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.011360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:30:27.016580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:27.017769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:30:27.018640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 594/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:30:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:30:27.023759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:27.101961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:27.122272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b0c27-c96b-4e3d-ab2e-2b350edcdcad None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.157730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a152ad-c899-4339-af3e-56301734063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.158341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a152ad-c899-4339-af3e-56301734063d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.158624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a152ad-c899-4339-af3e-56301734063d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.158896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a152ad-c899-4339-af3e-56301734063d None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.159571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a152ad-c899-4339-af3e-56301734063d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:27.159879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a152ad-c899-4339-af3e-56301734063d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:27.161255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a152ad-c899-4339-af3e-56301734063d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.169637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 595/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:30:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:27.177159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:27.257776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:27.279669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a983d3-283b-4035-bd72-6f4de2a9e564 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.316510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.317129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.317436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.317708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] PATH_INFO: `/v3/users/c1e97ee5abe14820a55796dd7610ba44` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.318820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] RBAC: Authorizing `identity:get_user(user_id=c1e97ee5abe14820a55796dd7610ba44)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:27.320256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.321875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 595/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:30:27 2022] GET /identity/v3/users/c1e97ee5abe14820a55796dd7610ba44 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:27.328334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a152ad-c899-4339-af3e-56301734063d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:27.426572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a152ad-c899-4339-af3e-56301734063d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.460672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb4db2-3d73-44d7-897b-40cbe617e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.461299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb4db2-3d73-44d7-897b-40cbe617e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.461610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb4db2-3d73-44d7-897b-40cbe617e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.461882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb4db2-3d73-44d7-897b-40cbe617e9a7 None admin] PATH_INFO: `/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.463240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb4db2-3d73-44d7-897b-40cbe617e9a7 None admin] RBAC: Authorizing `identity:get_project(project_id=c9dccee2d4dd4a5297f94b97a8270a27)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:27.464669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb4db2-3d73-44d7-897b-40cbe617e9a7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.466324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 596/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:30:27 2022] GET /identity/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:27.474060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:27.577715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d912-6504-4101-b9fa-9f263771d9df None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:27.610542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442cfa1-ac2c-40fb-8dc6-129fefca64e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:27.611182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442cfa1-ac2c-40fb-8dc6-129fefca64e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:27.611456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442cfa1-ac2c-40fb-8dc6-129fefca64e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:27.611725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442cfa1-ac2c-40fb-8dc6-129fefca64e5 None admin] PATH_INFO: `/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27/users/c1e97ee5abe14820a55796dd7610ba44/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:27.613590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442cfa1-ac2c-40fb-8dc6-129fefca64e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c9dccee2d4dd4a5297f94b97a8270a27, user_id=c1e97ee5abe14820a55796dd7610ba44, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:27.615008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442cfa1-ac2c-40fb-8dc6-129fefca64e5 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:27.627925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 596/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:30:27 2022] PUT /identity/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27/users/c1e97ee5abe14820a55796dd7610ba44/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:30:29.536110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b53d-5491-45b4-87f1-bde65cd631f4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.536647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b53d-5491-45b4-87f1-bde65cd631f4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.536647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b53d-5491-45b4-87f1-bde65cd631f4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.537941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 597/1193] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:30:29.543271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:29.543707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:29.543799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:29.566622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:30:29.567814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:30:29.570767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:29.634611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 597/1194] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:30:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:30:29.900805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3b53d-5491-45b4-87f1-bde65cd631f4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:29.914659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:30.001501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3b53d-5491-45b4-87f1-bde65cd631f4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.035001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.035607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.035880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.036145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.046359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:30:30.050964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:30:30.052056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:30:30.052959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 598/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:30:30.058166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:30.154686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0e2e-4cad-4c6b-aef9-a9389aa9b887 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.188754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.189372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.189656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.189935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.190593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:30.190893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.192260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.200147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 598/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:30.206664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:30.274097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:30.305688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13f550-f1ad-4c27-877c-38ff82988b42 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.339275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.339888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.340161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.340426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] PATH_INFO: `/v3/users/c1e97ee5abe14820a55796dd7610ba44` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.341614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c1e97ee5abe14820a55796dd7610ba44)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.343115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.344661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 599/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Mon Aug 29 23:30:30 2022] GET /identity/v3/users/c1e97ee5abe14820a55796dd7610ba44 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:30.350636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:30.353494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:30.450318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5abb-1b66-43bb-b07c-3c8cb4138252 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.483470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.484073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.484350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.484621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.549756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.551205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.552982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:30.659973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 599/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:30:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:30:30.665966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:30.773037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257468b-c442-494b-a12e-de0b5afdc8d3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.807234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168176d-3eec-44d3-b76b-c9b08b43edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.807852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168176d-3eec-44d3-b76b-c9b08b43edb8 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.808121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168176d-3eec-44d3-b76b-c9b08b43edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.808387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168176d-3eec-44d3-b76b-c9b08b43edb8 None admin] PATH_INFO: `/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.809531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168176d-3eec-44d3-b76b-c9b08b43edb8 None admin] RBAC: Authorizing `identity:get_project(project_id=c9dccee2d4dd4a5297f94b97a8270a27)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.810962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f168176d-3eec-44d3-b76b-c9b08b43edb8 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.813179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 600/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Mon Aug 29 23:30:30 2022] GET /identity/v3/projects/c9dccee2d4dd4a5297f94b97a8270a27 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:30.819335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:30:30.923284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fbe32-8adc-4c56-a3ab-d3bcf6a62c9b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:30:30.924747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:30.959207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:30:30.959812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:30:30.960094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:30:30.960365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:30:30.961081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=c9dccee2d4dd4a5297f94b97a8270a27, user.id=c1e97ee5abe14820a55796dd7610ba44) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:30:30.961424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:30:30.963117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449a0c5-1ead-480e-b0df-39adc5a69c75 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:30:30.971897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 600/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:30:30 2022] GET /identity/v3/role_assignments?user.id=c1e97ee5abe14820a55796dd7610ba44&scope.project.id=c9dccee2d4dd4a5297f94b97a8270a27&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:30:40.803501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:30:40.966416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=17 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:27.081884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc4db-d14e-4f10-9b72-4eabe6b697d1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:27.082480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc4db-d14e-4f10-9b72-4eabe6b697d1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:27.082480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5befc4db-d14e-4f10-9b72-4eabe6b697d1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:27.085002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 601/1201] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:27.089680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:27.090193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:27.090289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:27.108920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:27.110228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:27.204638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 601/1202] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:27.478779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc4db-d14e-4f10-9b72-4eabe6b697d1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:27.638719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5befc4db-d14e-4f10-9b72-4eabe6b697d1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:27.687727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:27.688398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:27.688722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:27.689081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:27.701495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:27.703265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:27.719615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:27.722185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:27.723175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:27.723175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:27.723175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:27.723175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 602/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:27.727164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:27.870997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4a0613-3543-4939-940a-b74266e467c8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:27.910866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:27.917107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:27.917741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:27.918016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:27.919020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:27.919706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:27.920008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:27.921399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea53629-6ff2-4a8c-8888-2924bf6d961d None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:27.934630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 602/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:27.940415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:28.011646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:28.068202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c83c44-7821-4692-8c5c-c43b2e572bd9 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:28.110921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a9af9-6dbc-47e8-83ed-8ac995632eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:28.111611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a9af9-6dbc-47e8-83ed-8ac995632eed None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:28.111865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a9af9-6dbc-47e8-83ed-8ac995632eed None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:28.112141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a9af9-6dbc-47e8-83ed-8ac995632eed None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:28.112807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a9af9-6dbc-47e8-83ed-8ac995632eed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:28.114375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a9af9-6dbc-47e8-83ed-8ac995632eed None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:28.140527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 603/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Mon Aug 29 23:31:27 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:31:30.208730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37569c-ccb9-4da8-a66b-b39b3c415e89 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:30.209304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37569c-ccb9-4da8-a66b-b39b3c415e89 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:30.209304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37569c-ccb9-4da8-a66b-b39b3c415e89 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:30.210790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 603/1206] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:30.216438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:30.216922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:30.217010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:30.237461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:30.238663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:30.314408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 604/1207] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:31:30.603647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37569c-ccb9-4da8-a66b-b39b3c415e89 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:30.745039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37569c-ccb9-4da8-a66b-b39b3c415e89 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:30.792714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:30.793634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:30.795178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:30.795178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:30.811059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:31:30.816664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:30.818588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:30.819444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 604/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:31:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:30.825329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:30.874886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:30.948863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eaae9-33c1-41b0-abd0-2e6411c2ccdc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:30.990910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:30.991530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:30.991811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:30.992084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:30.992754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:30.993196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:30.994731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:31.004924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 605/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:31:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:31.010964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:31.068811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:31.129860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbe0d5-da33-4b98-adf6-1ddd941ecc43 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:31.175371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:31.176084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:31.176408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:31.176682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:31.190853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:31.192410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:31.207219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:31.208429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:31.210161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:31.210161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:31.210161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:31.210161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 605/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:31.214691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:31.327205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:31.330271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d554268-315c-4acc-9905-3e19f5ecc03a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:31.368484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:31.369083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:31.369409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:31.369658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:31.370310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:31.370615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:31.372512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:31.394515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 606/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:31.395857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:31.508830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef77f5-8fcf-4caa-b821-515f6077131c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:31.510515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:31.547440 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:31.548084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:31.548415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:31.548765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:31.557424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:31.559026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:31:31.570873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:31.572074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:31.573037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 606/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:31.578339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:31.697459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7cd5-1451-4265-8320-0286ef5287b4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:31.738818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:31.739438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:31.739762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:31.740038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:31.740822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:31.741129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:31.742721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:31.761677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 607/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Aug 29 23:31:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:31.768683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:31.897888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bc51f-c1ff-4944-95d4-e30c096a7e05 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:31.938134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:31.938773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:31.939053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:31.939377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:31.972089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:32.011480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:32.013808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:32.141618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 607/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:31:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:31:32.142928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:32.171123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:32.275172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8383f452-cc41-4c40-863e-25c2976ba631 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:32.317548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:32.318181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:32.318459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:32.318730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:32.332598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:32.334298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:32.352696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:32.354001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:32.360740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:32.360740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:32.360740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:32.360740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 608/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:32.362662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:32.431263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:32.481137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387812d-22f1-4492-9244-05802ea06b9c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:32.518355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:32.519015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:32.519309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:32.519607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:32.520278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:32.520599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:32.522095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:32.534801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 608/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:32.540748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:32.618851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:32.653640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca131a9-bb14-48be-8969-06e1de18057e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:32.695152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:32.695790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:32.696056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:32.696330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:32.703787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:32.705231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:31:32.717328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:32.718398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:32.724499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 609/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:32.726235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:32.847940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aef92b-b807-48d2-a393-869a6a567e52 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:32.881946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:32.900333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:32.900977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:32.901251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:32.901569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:32.902416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:32.902749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:32.904251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5228e25c-0791-4b74-97ea-72d953582188 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:32.917192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 609/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:32.924328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:33.051979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b267de-a85c-4c5a-bbeb-c1ebfdf62180 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:33.082735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:33.091645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:33.092291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:33.092657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:33.092938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:33.093885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=6548e5f5d9e24b4eadde36b3b8a37882) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:33.094273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:33.095861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15d0a-8052-4abb-bbfa-d999b8c2f1a7 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:33.102261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 610/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:31:32 2022] GET /identity/v3/role_assignments?user.id=6548e5f5d9e24b4eadde36b3b8a37882&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:35.107673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b01a6-427f-4fe9-abd4-c0aa9494dfde None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:35.108247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b01a6-427f-4fe9-abd4-c0aa9494dfde None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:35.108247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b01a6-427f-4fe9-abd4-c0aa9494dfde None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:35.109600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 610/1220] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:35.114975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:35.115486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:35.115574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:35.134113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:35.135504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:35.211946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 611/1221] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:35.520170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b01a6-427f-4fe9-abd4-c0aa9494dfde None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:35.628556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b01a6-427f-4fe9-abd4-c0aa9494dfde None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:35.672668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:35.673300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:35.673602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:35.673870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:35.686948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:31:35.692686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:35.693898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:35.694970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 611/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:31:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:35.705063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:35.828230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25ccb1-4d0c-43d7-b704-e91dc506f842 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:35.854743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:35.866704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:35.867321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:35.867599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:35.867868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:35.868533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:35.868835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:35.870240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:35.879712 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 612/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:31:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:35.885718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:35.935954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:36.002597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193bd114-ef02-449a-a6ca-90034217dba0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:36.037664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:36.038288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:36.038565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:36.038832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:36.049996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:36.051485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:36.066653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:36.067802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:36.068772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:36.068772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:36.068772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:36.068772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 612/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:31:36.073968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:36.193622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c08f17-30ec-46c8-8087-75601bf00f8a None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:36.231322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:36.231929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:36.232208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:36.232479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:36.233137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:36.233454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:36.234829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:36.249037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 613/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:31:36.256068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:36.370885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:36.379636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8fa778-49ee-41df-8336-aa84737aee3f None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:36.422195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:36.422794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:36.423327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:36.423681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:36.434768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:36.437039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:31:36.450170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:36.451245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:36.452810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 613/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:36.458531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:36.516308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:36.579472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940cd705-8220-4870-8a60-2f21f589096c None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:36.619463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:36.620282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:36.620533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:36.620805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:36.622259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:36.622580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:36.624407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:36.644936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 614/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Aug 29 23:31:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:36.651157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:36.785061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438738b-49dd-4170-9491-8f4c5feb07e0 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:36.827942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:36.828571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:36.828848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:36.829135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:36.841301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:36.843075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:36.859307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:36.860483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:36.861608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:36.861608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:36.861608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:36.861608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 614/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:31:36.867517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:36.985581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482559bd-7370-4557-9a44-9dd6758c4ca1 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:36.988062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:37.024723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:37.025337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:37.025644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:37.025954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:37.026716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:37.027018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:37.029150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:37.040837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 615/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:37.047564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:37.058627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:37.169690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd16305-f865-465f-9b56-bd95df63426a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:37.208653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:37.209298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:37.209594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:37.209870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:37.217739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:37.219498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:31:37.231953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:37.232931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:37.233891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 615/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:37.239495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:37.355634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93b73c-6269-4269-a2f2-80da2a516e1f None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:37.394648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:37.395334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:37.395615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:37.395914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:37.396621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:37.396928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:37.398392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5675f-0251-451d-900c-f443b8a10092 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:37.411956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 616/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:37.418466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:37.500295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:37.538813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac1b0c-5506-4416-8272-5d122595c63b None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:37.576101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c827a-91f4-4e6b-93af-014d9b5cc1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:37.576752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c827a-91f4-4e6b-93af-014d9b5cc1f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:37.577029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c827a-91f4-4e6b-93af-014d9b5cc1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:37.577297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c827a-91f4-4e6b-93af-014d9b5cc1f1 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/6548e5f5d9e24b4eadde36b3b8a37882/roles/2d73184525784362a78020ab3ee1ad1b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:37.593183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c827a-91f4-4e6b-93af-014d9b5cc1f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=6548e5f5d9e24b4eadde36b3b8a37882, role_id=2d73184525784362a78020ab3ee1ad1b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:37.594661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9c827a-91f4-4e6b-93af-014d9b5cc1f1 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:37.608614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 616/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:31:37 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/6548e5f5d9e24b4eadde36b3b8a37882/roles/2d73184525784362a78020ab3ee1ad1b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:39.577072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669801c3-089e-4cfd-bfa1-38cdf5baf806 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:39.577686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669801c3-089e-4cfd-bfa1-38cdf5baf806 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:39.577686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669801c3-089e-4cfd-bfa1-38cdf5baf806 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:39.578887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 617/1233] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:39.584173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:39.584612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:39.584716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:39.604842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:39.606135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:39.680262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 617/1234] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:39.958544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669801c3-089e-4cfd-bfa1-38cdf5baf806 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:39.986770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.079238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669801c3-089e-4cfd-bfa1-38cdf5baf806 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.116810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.117468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.117793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.118067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.129924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:31:40.134637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:40.136114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:40.136997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 618/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Mon Aug 29 23:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:40.142242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:40.193067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.256158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577fb84-d8ee-4581-89da-5d69be84687f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.298013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.298916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.299341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.299618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.300384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:40.300675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:40.302324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:40.311803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 618/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Mon Aug 29 23:31:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:40.317884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:40.419887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.437924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3162-ed42-4e89-8c94-3886b18fe4ab None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.479830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.480975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.481338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.481626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.494303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:40.495802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:40.513760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:40.515040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:40.516023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:40.516023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:40.516023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:40.516023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 619/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:40.521319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:40.642160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ce348-4e15-4e9a-a5cf-9d9b2f93df5e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.653662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.680443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.681046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.681321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.681626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.682257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:40.682549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:40.683939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:40.698221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 619/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:31:40.704104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:40.824793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87254fbd-b11d-40b6-93ca-5e9f0bf85e97 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:40.864543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:40.865170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:40.865491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:40.865761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:40.869125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:40.875258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:40.877099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:31:40.890352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:40.891473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:40.892430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 620/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:40.898036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:41.013179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee153b-f43b-497b-a9fc-23e161348f29 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:41.048694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:41.049287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:41.049589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:41.049861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:41.050582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:41.050880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:41.052306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:41.070134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 620/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Aug 29 23:31:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:41.076941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:41.193206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d85a3e-400e-4699-b1bd-15fec9649be4 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:41.234228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:41.234924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:41.235240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:41.235571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:41.305717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:41.314025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:41.315653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:41.456283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 621/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:31:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:31:41.463710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:41.501610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:41.588937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214acee1-8020-4278-9769-99a207e21b90 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:41.627650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:41.628406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:41.629679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:41.629679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:41.640579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:41.642115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:41.657095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:41.658816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:41.659943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:41.659943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:41.659943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:41.659943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 621/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:41.664236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:41.788101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:41.795443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609e37-6b35-4aac-abeb-7a95218a1943 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:41.835605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:41.836215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:41.836493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:41.836759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:41.837684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:41.837982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:41.839598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:41.852264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 622/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:41.859168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:41.946490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:41.970223 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc2092-c2ea-4554-9bf3-f626f82d0da8 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:42.017581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:42.018371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:42.018697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:42.018922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:42.026052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:42.028266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:31:42.040855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:42.041846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:42.042925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 622/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:31:42.049263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:42.172584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdccaa-6fd6-4daa-84c4-e704a9543c62 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:42.215874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:42.216521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:42.216797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:42.217064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:42.217819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:42.218117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:42.219537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19ae66-4019-4a68-bf0d-25a315ac4b83 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:42.234907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 623/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:31:42.242214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:42.358027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d290e-0dbe-4cc9-a6c8-6b99bca1f83a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:42.396441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:42.397059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:42.397343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:42.397645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:42.398386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] RBAC: Adding query filter params (role.id=2d73184525784362a78020ab3ee1ad1b, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=6548e5f5d9e24b4eadde36b3b8a37882) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:42.398689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:42.400248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62546b4e-02e2-4d70-aa6b-5951f1328557 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:42.411611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 623/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:31:42 2022] GET /identity/v3/role_assignments?user.id=6548e5f5d9e24b4eadde36b3b8a37882&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=2d73184525784362a78020ab3ee1ad1b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:44.538765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830ec7-27da-4758-919b-97719eb66546 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:44.539378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830ec7-27da-4758-919b-97719eb66546 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:44.539378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830ec7-27da-4758-919b-97719eb66546 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:44.540618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 624/1247] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:44.546191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:44.546707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:44.546802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:44.553970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:44.568484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:44.569717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:44.646768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 624/1248] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:44.932875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b830ec7-27da-4758-919b-97719eb66546 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:44.952928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:45.049488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b830ec7-27da-4758-919b-97719eb66546 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:45.089018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:45.090237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:45.090515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:45.090784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:45.103038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:31:45.108563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:45.109930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:45.110798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 625/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:31:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:45.116539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:45.243262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea162f88-218d-4ac1-a3d1-c458be64c285 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:45.277899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:45.284250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:45.284855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:45.285131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:45.285422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:45.286150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:45.286449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:45.287840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:45.297425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 625/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:31:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:45.303580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:45.397182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:45.425745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b815fae-c047-412e-b3a3-ef0b874b68b7 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:45.471709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:45.472412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:45.472682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:45.473004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:45.484948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:45.486582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:45.505810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:45.506950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:45.507907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:45.507907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:45.507907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:45.507907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 626/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:45.513838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:45.629575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a340-e819-4f0f-b41a-9d839ea91404 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:45.670415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:45.671012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:45.671294 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:45.671563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:45.672199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:45.672499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:45.673945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:45.691733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 626/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:45.692959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:45.812951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1e7d2-a9e8-48da-b041-d7bd6c4cb3d3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:45.843187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:45.852131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:45.852880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:45.853185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:45.853556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:45.864135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:45.865728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:31:45.879241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:45.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:45.882064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 627/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 29 23:31:45.886805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:45.947608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:45.999067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4ace9-f8c1-4451-bdc5-c4e84939616e None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:46.044995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:46.045634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:46.045925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:46.046221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:46.047153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:46.047538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:46.049177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:46.068793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 627/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Aug 29 23:31:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:46.075150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:46.185049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c71b7-1720-4c14-911a-e7d3a16c4568 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:46.221004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:46.222035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:46.222299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:46.222560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:46.279304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:46.292008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:46.293545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:46.414620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 628/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:31:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:31:46.415889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:46.540139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c265ec-b65a-4f91-bc39-bc32293c22a7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:46.553602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:46.579854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:46.580504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:46.580809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:46.581069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:46.592118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:46.593598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:46.608588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:46.609859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:46.611232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:46.611232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:46.611232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:46.611232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 628/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:46.615574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:46.711812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:46.725785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df61cc0-e876-43cd-90e5-57649c27e951 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:46.765074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:46.765715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:46.765993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:46.766264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:46.766911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:46.767214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:46.768587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:46.781583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 629/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:46.787983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:46.910737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2014-a4be-4d6f-bdda-47948a2acc76 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:46.951511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:46.952073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:46.952348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:46.952617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:46.959885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:46.961541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:31:46.975619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:46.976680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:46.977659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 629/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:46.983353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:47.092268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffa4f2-7205-4f68-b5cb-82014eb38758 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:47.132983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:47.133668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:47.133950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:47.134222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:47.135004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:47.135327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:47.136959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f40c20-d270-459a-a698-3c43f72ff439 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:47.152032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 630/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:47.158463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:47.187968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:47.276534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4b937-4099-4403-9a1c-3adf297494e7 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:47.313964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:47.314572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:47.314846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:47.315110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:47.315830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=6548e5f5d9e24b4eadde36b3b8a37882) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:47.316131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:47.317590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca3e86c-a17b-4fa5-9227-49c890b2f2ba None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:47.323514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 630/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:31:47 2022] GET /identity/v3/role_assignments?user.id=6548e5f5d9e24b4eadde36b3b8a37882&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=0c9309017d3143658120ff04160bea6f => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:49.264544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940763a-faf0-46fa-b1b1-1e4444e8e466 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:49.265131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940763a-faf0-46fa-b1b1-1e4444e8e466 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:49.265131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940763a-faf0-46fa-b1b1-1e4444e8e466 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:49.266448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 631/1261] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:49.271431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:49.271917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:49.272020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:49.291311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:49.292517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:49.356838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 631/1262] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:49.642116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940763a-faf0-46fa-b1b1-1e4444e8e466 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:49.653006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:49.742948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940763a-faf0-46fa-b1b1-1e4444e8e466 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:49.777308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:49.777956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:49.778888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:49.778888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:49.793678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:31:49.798410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:49.799606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:49.800686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 632/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:49.805648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:49.824787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:49.903873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a785f-21b5-44c7-9e91-15127de1074c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:49.937674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:49.938269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:49.938550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:49.938822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:49.939478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:49.939778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:49.941149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:49.949019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 632/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:31:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:49.955032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.020706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:50.053899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf7154-320b-428e-bb24-4256c96719b3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:50.086511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:50.087124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:50.087663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:50.087930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:50.098266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:50.099698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:50.114622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:50.115807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:50.116946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:50.116946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:50.116946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:50.116946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 633/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:50.122166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.201718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:50.221693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74879317-a3e4-48d7-a1ec-772aa2ece06c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:50.255231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:50.255818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:50.256097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:50.256367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:50.256997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:50.257299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:50.258720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:50.270318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 633/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:50.276017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.374160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52f01a-3ce7-42fe-aa8c-02664cb4ef81 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:50.392823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:50.407096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:50.407705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:50.407978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:50.408244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:50.415548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:50.416972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:31:50.428367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:50.429530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:50.430758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 634/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:50.436470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.552849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4c3f-1246-4180-afd7-3387a04e9388 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:50.585307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:50.585924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:50.586198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:50.586463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:50.587428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:50.587736 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:50.589742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:50.598079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:50.607831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 634/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Aug 29 23:31:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:50.613702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.712903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ab567-233e-4ec9-8c83-13854da50fd3 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:50.747279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:50.747902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:50.748175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:50.748442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:50.759595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:50.766790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:50.789331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:50.790666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:50.791782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:50.791782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:50.791782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:50.791782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 635/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:50.798020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.898721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd924-c217-497c-a09f-b4a92cbe4cc9 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:50.932144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:50.932737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:50.933042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:50.933313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:50.933973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:50.934273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:50.935641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:50.946570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 635/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:50.952886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:50.984338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:51.050981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af79649-fedf-485f-9383-86c632f51479 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:51.085154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:51.085814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:51.086088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:51.086354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:51.095960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:51.098159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:31:51.114693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:51.115823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:51.116987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 636/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:31:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:51.122425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:51.180374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:51.222993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92306dec-ab20-43fa-bf25-8fcc35be1fab None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:51.255897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:51.256488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:51.256764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:51.257029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:51.257733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:51.258030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:51.259449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3b492-0f41-4a9b-8975-a0ae62e3b48e None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:51.271868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 636/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:31:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:51.278137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:51.368426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:51.377779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d51c0b-406e-4986-b5fc-7bf24d86a87e None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:51.414842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56abb0-1667-475a-b068-155ba0caa815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:51.415417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56abb0-1667-475a-b068-155ba0caa815 None admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:51.415690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56abb0-1667-475a-b068-155ba0caa815 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:51.415961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56abb0-1667-475a-b068-155ba0caa815 None admin] PATH_INFO: `/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/6548e5f5d9e24b4eadde36b3b8a37882/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:51.418345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56abb0-1667-475a-b068-155ba0caa815 None admin] RBAC: Authorizing `identity:create_grant(project_id=1af80d493522441c83c64a8e6cd193fd, user_id=6548e5f5d9e24b4eadde36b3b8a37882, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:51.419774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56abb0-1667-475a-b068-155ba0caa815 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:51.432386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 637/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Mon Aug 29 23:31:51 2022] PUT /identity/v3/projects/1af80d493522441c83c64a8e6cd193fd/users/6548e5f5d9e24b4eadde36b3b8a37882/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:31:53.324251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de934f-c555-4780-b1eb-86a2340328e9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:53.324776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de934f-c555-4780-b1eb-86a2340328e9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:53.324776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de934f-c555-4780-b1eb-86a2340328e9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:53.326176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 637/1274] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:53.331290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:53.331719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:53.331829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:53.350446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:53.351607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:53.417090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 638/1275] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:53.711812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de934f-c555-4780-b1eb-86a2340328e9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:53.816548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de934f-c555-4780-b1eb-86a2340328e9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:53.833573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:53.851044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:53.851657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:53.851932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:53.852198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:53.861996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 29 23:31:53.866641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:53.867794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:53.868693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 638/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Mon Aug 29 23:31:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:53.873768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:53.953376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:53.972480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638c60d-c690-4112-a46f-48fbb42a8f47 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:54.005409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:54.006005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:54.006279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:54.006547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:54.007201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:54.007497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:54.008858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:54.017332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 639/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Mon Aug 29 23:31:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:31:54.023090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:54.121228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc4977-4660-43c1-abab-06b8f8e9bf8c None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:54.156524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:54.157149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:54.157457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:54.157736 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:54.167846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:54.169308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:54.183941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:54.189489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:54.190652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:54.190652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:54.190652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:54.190652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 639/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:54.191050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:54.290174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad5ac-1228-4f3c-b57a-7e257659e2bc None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:54.323095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:54.324247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:54.324528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:54.324800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:54.325464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:54.325769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:54.327136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:54.338846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 640/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:54.344528 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:54.376572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:54.447942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c564b-4972-44d2-b754-c1191c797630 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:54.483193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:54.483812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:54.484089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:54.484355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:54.491617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:54.493053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 29 23:31:54.504508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:54.505946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:54.507236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 640/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:54.511551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:54.515349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:54.610018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcc0db-5520-4c1e-a995-937b61eb8d1d None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:54.643025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:54.643694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:54.643898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:54.644168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:54.644892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:54.645195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:54.646646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:54.664313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 641/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Mon Aug 29 23:31:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:54.670773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:54.761787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:54.771848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e319e2-89c7-4d20-9159-0b463ce6f7c6 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:54.806067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:54.806686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:54.806963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:54.807235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:54.873277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:54.874685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:54.960693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:54.971816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 641/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Mon Aug 29 23:31:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 29 23:31:54.977611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:55.037114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:55.075711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fa7a8-952e-4ab7-9637-4fd0febf2cbf None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:55.111598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:55.112225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:55.112499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:55.112764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:55.122832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:55.124317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 29 23:31:55.138923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:55.140079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 29 23:31:55.140992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 29 23:31:55.140992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 29 23:31:55.140992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:55.140992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 642/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:55.145816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:55.243523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f6a13-c8e7-4943-9a03-6c17c75ce887 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:55.277465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:55.278060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:55.278339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:55.278610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:55.279240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:55.279541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:55.280919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:55.291895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 642/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Mon Aug 29 23:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:55.297594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:55.395281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc515-d1c1-41b3-82da-206ef2f44ae2 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:55.408787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:55.428218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:55.428828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:55.429103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:55.429389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:55.435949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:55.437400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 29 23:31:55.449380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:55.450451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: ERROR keystone.server.flask.application Aug 29 23:31:55.451426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 643/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Mon Aug 29 23:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:55.456470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:55.506866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:55.556287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a30e8-eb52-4982-8980-cce5c29c76af None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:55.589970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efef51-261b-435a-bee0-4194f565006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:55.590570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efef51-261b-435a-bee0-4194f565006a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:55.590934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efef51-261b-435a-bee0-4194f565006a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:55.591119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efef51-261b-435a-bee0-4194f565006a None admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:55.591792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efef51-261b-435a-bee0-4194f565006a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:55.592094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efef51-261b-435a-bee0-4194f565006a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:55.593547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efef51-261b-435a-bee0-4194f565006a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:55.605763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 643/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Mon Aug 29 23:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:55.612031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:55.711405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a303a-50e0-4cec-af76-6a5b0dd31183 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:55.746148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:55.746743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:55.747021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:55.747292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:55.748013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] RBAC: Adding query filter params (role.id=0c9309017d3143658120ff04160bea6f, scope.project.id=1af80d493522441c83c64a8e6cd193fd, user.id=6548e5f5d9e24b4eadde36b3b8a37882) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:55.748320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:55.749792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc80bfb-c972-432f-9105-9f4d610ebf32 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:55.755490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 644/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Mon Aug 29 23:31:55 2022] GET /identity/v3/role_assignments?user.id=6548e5f5d9e24b4eadde36b3b8a37882&scope.project.id=1af80d493522441c83c64a8e6cd193fd&role.id=0c9309017d3143658120ff04160bea6f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:57.671797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d8766-1bd8-43f1-8bc1-38ca190d2652 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:57.672325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d8766-1bd8-43f1-8bc1-38ca190d2652 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:57.672325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d8766-1bd8-43f1-8bc1-38ca190d2652 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:57.673717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 644/1288] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:31:57.679168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:57.679549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:57.679756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:57.698370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:31:57.699551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:31:57.729027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:57.767002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 645/1289] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:31:58.030462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d8766-1bd8-43f1-8bc1-38ca190d2652 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:58.130623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d8766-1bd8-43f1-8bc1-38ca190d2652 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:58.142680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:31:58.170500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:58.171117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:58.171393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:58.171727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:58.172241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:58.173665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:31:58.182376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:31:58.183678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:31:58.184584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 645/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:31:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:31:58.189489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:58.285887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875b426-64bc-4a15-9c99-214c9b2ded58 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:58.318935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:58.319527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:58.319810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:58.320078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:58.320692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:58.320989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:58.322377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bbd50-56ef-488b-bbc7-613f3bfdeed2 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:58.327573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 646/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Aug 29 23:31:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:31:58.333373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:31:58.434947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799df6d9-b883-47af-92b3-ab66fdb4e179 None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:31:58.478938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:31:58.479773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:31:58.479986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:31:58.480514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] PATH_INFO: `/v3/services` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:31:58.481582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:31:58.481921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:31:58.483719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbbec1-8a8e-4e45-afdc-578a947abf27 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:31:58.489087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 646/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Aug 29 23:31:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:32:00.373406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bada-6ed0-4f41-99cc-d1a35032d905 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:00.373968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bada-6ed0-4f41-99cc-d1a35032d905 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:00.373968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bada-6ed0-4f41-99cc-d1a35032d905 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:00.375255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 647/1293] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:32:00.380264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85b281-a8ae-4398-97f8-be2e0e6ea6bc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:00.380674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85b281-a8ae-4398-97f8-be2e0e6ea6bc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:00.380828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85b281-a8ae-4398-97f8-be2e0e6ea6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:00.398708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0a85b281-a8ae-4398-97f8-be2e0e6ea6bc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:32:00.399936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0a85b281-a8ae-4398-97f8-be2e0e6ea6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:00.429213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:00.467135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 647/1294] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:32:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:32:00.735882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45bada-6ed0-4f41-99cc-d1a35032d905 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:00.766991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:00.837088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45bada-6ed0-4f41-99cc-d1a35032d905 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:00.870981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff48236-1ecf-4675-86e6-ff5b5a88db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:00.871578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48236-1ecf-4675-86e6-ff5b5a88db16 None admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:00.871855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48236-1ecf-4675-86e6-ff5b5a88db16 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:00.872121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff48236-1ecf-4675-86e6-ff5b5a88db16 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:00.872894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff48236-1ecf-4675-86e6-ff5b5a88db16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:00.874170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff48236-1ecf-4675-86e6-ff5b5a88db16 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:00.895275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 648/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Mon Aug 29 23:32:00 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:32:02.809630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f7cb-2512-4ef2-ae89-08e54a8049fc None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:02.810210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f7cb-2512-4ef2-ae89-08e54a8049fc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:02.810210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f7cb-2512-4ef2-ae89-08e54a8049fc None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:02.811523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 648/1296] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:32:02.817007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:02.817481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:02.817577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:02.835626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:32:02.836807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:02.909542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 649/1297] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:32:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 29 23:32:03.181490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f7cb-2512-4ef2-ae89-08e54a8049fc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:03.280409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f7cb-2512-4ef2-ae89-08e54a8049fc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:03.313300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:03.313938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:03.314216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:03.314482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:03.315055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:03.316420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:32:03.325423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:32:03.326610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:32:03.327894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 649/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:32:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:32:03.332609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:03.351233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:03.430426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac11cd-4047-415d-a5d8-0daa16fee617 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:03.488541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:03.489144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:03.489454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:03.489724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:03.490374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:32:03.490679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:03.492054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:03.499853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 650/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Aug 29 23:32:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:32:03.508392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:03.543970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:03.612256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d3c5e-af85-4780-a2d8-9ea1ede9cbeb None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:03.645661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:03.646255 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:03.646535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:03.646809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:03.647505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] RBAC: Adding query filter params (interface=public, service_id=d6ba1818b7a148839dc084071d62e44a, region_id=RegionOne) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:32:03.647814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:03.649182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4022c7-97b1-4757-a22f-1537d242a112 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:03.654736 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 650/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Mon Aug 29 23:32:03 2022] GET /identity/v3/endpoints?service_id=d6ba1818b7a148839dc084071d62e44a&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:32:03.660621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:03.741428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:03.760127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb2bb2-1d68-4d6e-a581-602678051623 None admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:03.793763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01bdc8-660a-45d4-8759-03c271ed5132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:03.794365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01bdc8-660a-45d4-8759-03c271ed5132 None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:03.794642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01bdc8-660a-45d4-8759-03c271ed5132 None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:03.794913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01bdc8-660a-45d4-8759-03c271ed5132 None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:03.795516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01bdc8-660a-45d4-8759-03c271ed5132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:03.796892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01bdc8-660a-45d4-8759-03c271ed5132 None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:03.806676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 651/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Mon Aug 29 23:32:03 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:32:05.711434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a67c22-8098-460e-a6b0-ca1bd5ce1705 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:05.711970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a67c22-8098-460e-a6b0-ca1bd5ce1705 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:05.711970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a67c22-8098-460e-a6b0-ca1bd5ce1705 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:05.713664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 651/1302] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:32:05.719625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:05.720313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:05.720313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:05.738018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:32:05.739195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:32:05.804397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 652/1303] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:32:05 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 29 23:32:06.085024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a67c22-8098-460e-a6b0-ca1bd5ce1705 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:06.187935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:06.195058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a67c22-8098-460e-a6b0-ca1bd5ce1705 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:06.228081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:06.228693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:06.228972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:06.229273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:06.229877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:06.231235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 29 23:32:06.239711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 29 23:32:06.240984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.get_or_create( Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application with Lock( Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self._enter() Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application return self.creator() Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application created_value = creator( Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: ERROR keystone.server.flask.application Aug 29 23:32:06.242058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 652/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Mon Aug 29 23:32:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 29 23:32:06.247485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:06.321878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:06.345342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e1126-5908-4cfb-b02c-f11e15df40d4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:06.379624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:06.380213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:06.380489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:06.380756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] PATH_INFO: `/v3/services` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:06.381386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:32:06.381687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:06.383039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076c910-8eb3-4d6a-8506-38072e707f0a None admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:06.388039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 653/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Mon Aug 29 23:32:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:32:06.394050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:32:06.523251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622a057-4f10-45b0-9259-a7a5bbc8d13a None admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:32:06.556967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5742f-4c3d-4f3f-a504-279ea249f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:32:06.558189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5742f-4c3d-4f3f-a504-279ea249f8d8 None admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:32:06.558467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5742f-4c3d-4f3f-a504-279ea249f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:32:06.558734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5742f-4c3d-4f3f-a504-279ea249f8d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:32:06.559400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5742f-4c3d-4f3f-a504-279ea249f8d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:32:06.560767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5742f-4c3d-4f3f-a504-279ea249f8d8 None admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:32:06.579309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 653/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:32:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:32:16.385735 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=30 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:32:16.575305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:11.078691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f390a-7657-42dd-90d4-1b348c589687 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:11.079266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f390a-7657-42dd-90d4-1b348c589687 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:11.079266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f390a-7657-42dd-90d4-1b348c589687 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:11.085770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059111d5-e058-4426-a858-1acc7ee91bf7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:11.086242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059111d5-e058-4426-a858-1acc7ee91bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:11.086366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059111d5-e058-4426-a858-1acc7ee91bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:11.089793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 654/1307] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:11.174972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-059111d5-e058-4426-a858-1acc7ee91bf7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:11.176697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-059111d5-e058-4426-a858-1acc7ee91bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:11.386269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 654/1308] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:11.686164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac50f6-5b51-4a9c-8ffa-b93b399b7dc1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:11.686526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac50f6-5b51-4a9c-8ffa-b93b399b7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:11.686710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac50f6-5b51-4a9c-8ffa-b93b399b7dc1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:11.688023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 655/1309] 10.222.0.67 () {54 vars in 965 bytes} [Mon Aug 29 23:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:11.694433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7639-0184-4464-8d4e-8f9bf5c012a6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:11.695028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7639-0184-4464-8d4e-8f9bf5c012a6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:11.695511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7639-0184-4464-8d4e-8f9bf5c012a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:11.792426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7b4e7639-0184-4464-8d4e-8f9bf5c012a6 None None] MFA Rules not processed for user `e0b4196792fe44f2a8fb31bba5a6006e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:11.793970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7b4e7639-0184-4464-8d4e-8f9bf5c012a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:11.818298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:11.886144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 655/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Mon Aug 29 23:33:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:11.895985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac50f6-5b51-4a9c-8ffa-b93b399b7dc1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:11.897805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3bac50f6-5b51-4a9c-8ffa-b93b399b7dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:12.020807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac50f6-5b51-4a9c-8ffa-b93b399b7dc1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:12.102921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:12.103911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:12.103911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:12.103911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:12.105606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:12.170028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:12.234389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:12.235888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598179fd-9868-407b-ba3a-33b41cbbb6b3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:12.255308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 656/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:33:14.497955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf025a2-bd32-4acf-8344-2ca8690f3cc8 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:14.498531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf025a2-bd32-4acf-8344-2ca8690f3cc8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:14.498531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf025a2-bd32-4acf-8344-2ca8690f3cc8 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:14.500937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 656/1312] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:14.505261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098680a8-b96d-4600-a8e9-7e2d3e68f035 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:14.505770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098680a8-b96d-4600-a8e9-7e2d3e68f035 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:14.505878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098680a8-b96d-4600-a8e9-7e2d3e68f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:14.594632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-098680a8-b96d-4600-a8e9-7e2d3e68f035 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:14.595886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-098680a8-b96d-4600-a8e9-7e2d3e68f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:14.705730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 657/1313] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:14.990594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf025a2-bd32-4acf-8344-2ca8690f3cc8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:14.992187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dcf025a2-bd32-4acf-8344-2ca8690f3cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:15.098305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf025a2-bd32-4acf-8344-2ca8690f3cc8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:15.172520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:15.176015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:15.176920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:15.177343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:15.177652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:15.179640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:15.306094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:15.307812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d0e3-e07e-44f6-86e0-9be4d73452cb service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:15.329331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 657/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:17.569867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520cf4-78e5-4469-bdb5-df00335a8093 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:17.570409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520cf4-78e5-4469-bdb5-df00335a8093 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:17.570409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520cf4-78e5-4469-bdb5-df00335a8093 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:17.572257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 658/1315] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:17.577828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204979bb-6e52-4b20-b08b-6bfd6a897a8a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:17.578248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204979bb-6e52-4b20-b08b-6bfd6a897a8a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:17.578384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204979bb-6e52-4b20-b08b-6bfd6a897a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:17.644034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-204979bb-6e52-4b20-b08b-6bfd6a897a8a None None] MFA Rules not processed for user `b89b287edf244e8abe3dd68d5134f421`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:17.645254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-204979bb-6e52-4b20-b08b-6bfd6a897a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:17.698783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:17.744380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 658/1316] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:18.027578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520cf4-78e5-4469-bdb5-df00335a8093 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:18.029150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd520cf4-78e5-4469-bdb5-df00335a8093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:18.039845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:18.132838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd520cf4-78e5-4469-bdb5-df00335a8093 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:18.212618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:18.213216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:18.213530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:18.213796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:18.215540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:18.278535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:18.324882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:18.326357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2adf037-a9f8-416b-89cb-165096d2c1a1 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:18.345720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 659/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:18 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:20.815726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f987-2dd2-4199-bda8-7566ed3eb003 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:20.816278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f987-2dd2-4199-bda8-7566ed3eb003 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:20.816278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f987-2dd2-4199-bda8-7566ed3eb003 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:20.817567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 659/1318] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:20.822778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b7fcf-985d-423e-94ca-2fa426e81557 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:20.823222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b7fcf-985d-423e-94ca-2fa426e81557 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:20.823317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b7fcf-985d-423e-94ca-2fa426e81557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:20.891069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8f9b7fcf-985d-423e-94ca-2fa426e81557 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:20.892276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f9b7fcf-985d-423e-94ca-2fa426e81557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:20.989715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 660/1319] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:21.297452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c20f-ab50-40cd-b8bc-54c81ecdebfd None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:21.297739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c20f-ab50-40cd-b8bc-54c81ecdebfd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:21.298015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c20f-ab50-40cd-b8bc-54c81ecdebfd None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:21.299377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 660/1320] 10.222.0.67 () {54 vars in 965 bytes} [Mon Aug 29 23:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:21.305464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416de914-6b9e-4bdc-b3fc-85d76ef2c274 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:21.305831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416de914-6b9e-4bdc-b3fc-85d76ef2c274 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:21.306213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416de914-6b9e-4bdc-b3fc-85d76ef2c274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:21.328424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:21.382334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-416de914-6b9e-4bdc-b3fc-85d76ef2c274 None None] MFA Rules not processed for user `e0b4196792fe44f2a8fb31bba5a6006e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:21.384020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-416de914-6b9e-4bdc-b3fc-85d76ef2c274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:21.466933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 661/1321] 10.222.0.67 () {58 vars in 1062 bytes} [Mon Aug 29 23:33:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:21.475775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c20f-ab50-40cd-b8bc-54c81ecdebfd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:21.477923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-94b0c20f-ab50-40cd-b8bc-54c81ecdebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:21.580168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c20f-ab50-40cd-b8bc-54c81ecdebfd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:21.650896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:21.651476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:21.651749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:21.652012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:21.653613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:21.660773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:21.762073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:21.763425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b139286-a817-4770-8218-6167f48efaf4 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:21.782511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 661/1322] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:24.846321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21905b-280f-4149-924c-5b2eb7fac858 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:24.846869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21905b-280f-4149-924c-5b2eb7fac858 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:24.846869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21905b-280f-4149-924c-5b2eb7fac858 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:24.848125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 662/1323] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:24.854042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611eb13-c1c6-4161-ac97-21ed59583a03 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:24.854465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611eb13-c1c6-4161-ac97-21ed59583a03 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:24.854576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611eb13-c1c6-4161-ac97-21ed59583a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:24.923641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8611eb13-c1c6-4161-ac97-21ed59583a03 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:24.924881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8611eb13-c1c6-4161-ac97-21ed59583a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:24.988573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:25.032499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 662/1324] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:25.318307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21905b-280f-4149-924c-5b2eb7fac858 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:25.319824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dd21905b-280f-4149-924c-5b2eb7fac858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:25.428989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21905b-280f-4149-924c-5b2eb7fac858 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:25.442449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:25.509101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:25.509728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:25.510008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:25.510278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:25.511897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:25.625531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:25.626969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453075bf-df73-4a44-b3e2-0d2171d43164 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:25.645765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 663/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:27.630284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e581-cbb4-41ec-ae79-8eda75a7a313 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:27.630822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e581-cbb4-41ec-ae79-8eda75a7a313 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:27.630822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84e581-cbb4-41ec-ae79-8eda75a7a313 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:27.632188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 663/1326] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:27.638088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3763-8b1e-494a-8f2e-7ded41f42b97 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:27.638555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3763-8b1e-494a-8f2e-7ded41f42b97 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:27.638748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a3763-8b1e-494a-8f2e-7ded41f42b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:27.687424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:27.707354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e38a3763-8b1e-494a-8f2e-7ded41f42b97 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:27.708552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e38a3763-8b1e-494a-8f2e-7ded41f42b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:27.809183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 664/1327] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:28.091438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e581-cbb4-41ec-ae79-8eda75a7a313 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:28.092983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5b84e581-cbb4-41ec-ae79-8eda75a7a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:28.213515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84e581-cbb4-41ec-ae79-8eda75a7a313 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:28.290077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:28.290691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:28.290970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:28.291239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:28.292862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:28.310997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:28.405749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:28.407237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666217ee-746d-4f87-b7eb-ade78a6e98e9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:28.425166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 664/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:30.430363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e1cf-1ff0-491c-b0e5-0f6392129501 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:30.430948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e1cf-1ff0-491c-b0e5-0f6392129501 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:30.431054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6e1cf-1ff0-491c-b0e5-0f6392129501 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:30.432563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 665/1329] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:30.438712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0c7a-4aed-42f2-99a5-cd89a4a93d1f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:30.439286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0c7a-4aed-42f2-99a5-cd89a4a93d1f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:30.439286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad0c7a-4aed-42f2-99a5-cd89a4a93d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:30.508229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-85ad0c7a-4aed-42f2-99a5-cd89a4a93d1f None None] MFA Rules not processed for user `b89b287edf244e8abe3dd68d5134f421`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:30.509474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-85ad0c7a-4aed-42f2-99a5-cd89a4a93d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:30.574224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:30.607271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 665/1330] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:30.892422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e1cf-1ff0-491c-b0e5-0f6392129501 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:30.894006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1fd6e1cf-1ff0-491c-b0e5-0f6392129501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:31.008161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6e1cf-1ff0-491c-b0e5-0f6392129501 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:31.027801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:31.082935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:31.083456 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:31.083734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:31.084005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:31.085694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:31.205996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:31.207355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9de87-bda5-4636-8df7-d740e8ebe153 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:31.225593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 666/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:33:33.373601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b4027-634e-47f6-ad74-e6f7cd3b0e2a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:33.374162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b4027-634e-47f6-ad74-e6f7cd3b0e2a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:33.374162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b4027-634e-47f6-ad74-e6f7cd3b0e2a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:33.375490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 666/1332] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:33.380566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad0ddb-9559-42d6-a4b4-d7e997edd45b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:33.380958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad0ddb-9559-42d6-a4b4-d7e997edd45b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:33.381130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad0ddb-9559-42d6-a4b4-d7e997edd45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:33.446822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:33.449856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f3ad0ddb-9559-42d6-a4b4-d7e997edd45b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:33.451406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f3ad0ddb-9559-42d6-a4b4-d7e997edd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:33.549562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 667/1333] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:33.830910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b4027-634e-47f6-ad74-e6f7cd3b0e2a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:33.832479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-561b4027-634e-47f6-ad74-e6f7cd3b0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:33.937218 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b4027-634e-47f6-ad74-e6f7cd3b0e2a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:34.009636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:34.010240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:34.010520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:34.010797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:34.012403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:34.040031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:34.122915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:34.124350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd4065-e72d-40f0-957d-19bfac6fcfeb service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:34.143151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 667/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:36.111089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054166-7468-429c-af33-e06b4b275fb7 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:36.111767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054166-7468-429c-af33-e06b4b275fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:36.111767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe054166-7468-429c-af33-e06b4b275fb7 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:36.113027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 668/1335] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:36.118363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac9bf-81a7-43b2-82f2-ee62acb1cafc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:36.118809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac9bf-81a7-43b2-82f2-ee62acb1cafc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:36.118905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eac9bf-81a7-43b2-82f2-ee62acb1cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:36.184912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-83eac9bf-81a7-43b2-82f2-ee62acb1cafc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:36.186153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-83eac9bf-81a7-43b2-82f2-ee62acb1cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:36.265370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:36.292824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 668/1336] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:36.577465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe054166-7468-429c-af33-e06b4b275fb7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:36.579202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fe054166-7468-429c-af33-e06b4b275fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:36.683227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe054166-7468-429c-af33-e06b4b275fb7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:36.711161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:36.756443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:36.757045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:36.757911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:36.758180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:36.759782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:36.874483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:36.875942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7925794-2efc-4353-a8a8-d91e32ab5203 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:36.902015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 669/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:39.189982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3962459-4b98-4f67-acfd-68b9a1cc5b28 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:39.190509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3962459-4b98-4f67-acfd-68b9a1cc5b28 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:39.190727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3962459-4b98-4f67-acfd-68b9a1cc5b28 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:39.191939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 669/1338] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:39.197093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c805e9-11f5-4a68-b857-c6e1b42c76db None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:39.197562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c805e9-11f5-4a68-b857-c6e1b42c76db None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:39.197657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c805e9-11f5-4a68-b857-c6e1b42c76db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:39.264019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-54c805e9-11f5-4a68-b857-c6e1b42c76db None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:39.265228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-54c805e9-11f5-4a68-b857-c6e1b42c76db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:39.274205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:39.366462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 670/1339] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:39.651532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3962459-4b98-4f67-acfd-68b9a1cc5b28 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:39.653199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f3962459-4b98-4f67-acfd-68b9a1cc5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:39.754184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3962459-4b98-4f67-acfd-68b9a1cc5b28 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:39.826801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:39.827393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:39.827664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:39.827924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:39.829536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:39.864133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:39.938845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:39.940210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4d8cf-ab3b-429c-90ba-3901c404a918 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:39.958625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 670/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:33:43.985118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b260-81b8-43d4-98fd-b2dc7dc88ef4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:43.985651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b260-81b8-43d4-98fd-b2dc7dc88ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:43.985651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7b260-81b8-43d4-98fd-b2dc7dc88ef4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:43.986947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 671/1341] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:43.992887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96fd2-8a00-47c6-99f7-f4509eef57a8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:43.993340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96fd2-8a00-47c6-99f7-f4509eef57a8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:43.993595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96fd2-8a00-47c6-99f7-f4509eef57a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:44.063820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-21f96fd2-8a00-47c6-99f7-f4509eef57a8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:44.065031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-21f96fd2-8a00-47c6-99f7-f4509eef57a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:44.157060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:44.169455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 671/1342] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:44.466793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b260-81b8-43d4-98fd-b2dc7dc88ef4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:44.468374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-efc7b260-81b8-43d4-98fd-b2dc7dc88ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:44.577341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7b260-81b8-43d4-98fd-b2dc7dc88ef4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:44.616853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:44.652933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:44.653560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:44.653837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:44.654107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:44.655696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:44.765212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:44.766595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d5e0d-de63-4066-b841-b6935831ad68 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:44.784853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 672/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:47.307228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed2fdf-5b7e-4920-a380-d9696ca708de None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:47.307764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed2fdf-5b7e-4920-a380-d9696ca708de None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:47.307764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed2fdf-5b7e-4920-a380-d9696ca708de None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:47.309101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 672/1344] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:47.314843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33399e03-40ce-416f-8fa5-0ee6cf9ed228 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:47.315378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33399e03-40ce-416f-8fa5-0ee6cf9ed228 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:47.315378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33399e03-40ce-416f-8fa5-0ee6cf9ed228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:47.384948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-33399e03-40ce-416f-8fa5-0ee6cf9ed228 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:47.386290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-33399e03-40ce-416f-8fa5-0ee6cf9ed228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:47.405226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:47.493109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 673/1345] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:47.775759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed2fdf-5b7e-4920-a380-d9696ca708de None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:47.777310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e6ed2fdf-5b7e-4920-a380-d9696ca708de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:47.881035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed2fdf-5b7e-4920-a380-d9696ca708de None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:47.959423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:47.960100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:47.960379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:47.960646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:47.962636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:48.011314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:48.078789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:48.080156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806f9766-eae5-4a57-99b8-6d12c3b165c5 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:48.098987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 673/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:52.071606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535acf7-1ec8-4eaf-86d3-61111c8b1638 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:52.072170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535acf7-1ec8-4eaf-86d3-61111c8b1638 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:52.072170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535acf7-1ec8-4eaf-86d3-61111c8b1638 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:52.076462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 674/1347] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:33:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:52.079045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e9f4-436e-48a7-84a2-9759c783362c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:52.079506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e9f4-436e-48a7-84a2-9759c783362c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:52.079611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583e9f4-436e-48a7-84a2-9759c783362c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:52.155388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e583e9f4-436e-48a7-84a2-9759c783362c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:52.156618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e583e9f4-436e-48a7-84a2-9759c783362c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:52.261312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:52.264459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 674/1348] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:33:52.546796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535acf7-1ec8-4eaf-86d3-61111c8b1638 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:33:52.548340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8535acf7-1ec8-4eaf-86d3-61111c8b1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:52.673490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535acf7-1ec8-4eaf-86d3-61111c8b1638 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:33:52.734549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:52.764659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:33:52.765468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:52.765846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:52.766249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:52.767984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:52.890884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:33:52.892339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a05f3-8887-4cbe-9fdc-042a5c05ec45 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:33:52.911349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 675/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:33:57.875485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97c09-b6ec-47d2-aaea-4c6aafd6b183 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:57.876009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97c09-b6ec-47d2-aaea-4c6aafd6b183 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:57.876644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab97c09-b6ec-47d2-aaea-4c6aafd6b183 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:57.884354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 675/1350] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:33:57.885023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7675251-66c0-4a2b-8324-f9f664ebcff0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:33:57.885023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7675251-66c0-4a2b-8324-f9f664ebcff0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:33:57.885023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7675251-66c0-4a2b-8324-f9f664ebcff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:33:57.996909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e7675251-66c0-4a2b-8324-f9f664ebcff0 None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:33:57.998150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e7675251-66c0-4a2b-8324-f9f664ebcff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:33:58.051376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:33:58.176981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 676/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:33:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:02.352247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9047-9f82-4b40-b8d3-ee969f3bca4f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:02.352775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9047-9f82-4b40-b8d3-ee969f3bca4f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:02.352775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c9047-9f82-4b40-b8d3-ee969f3bca4f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:02.354142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 676/1352] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:02.359279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fc1ad-99a4-4bdc-b449-9566341d1962 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:02.360050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fc1ad-99a4-4bdc-b449-9566341d1962 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:02.360479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4fc1ad-99a4-4bdc-b449-9566341d1962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:02.447549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2e4fc1ad-99a4-4bdc-b449-9566341d1962 None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:02.448656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2e4fc1ad-99a4-4bdc-b449-9566341d1962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:02.524639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:02.567820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 677/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:34:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:03.873006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba481e4-bb3c-4d2c-9ead-f148f4ef0139 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:03.873566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba481e4-bb3c-4d2c-9ead-f148f4ef0139 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:03.873821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba481e4-bb3c-4d2c-9ead-f148f4ef0139 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:03.875230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 677/1354] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:03.880497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565b3e3-6cba-45e9-88f3-edf5563bd27c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:03.881000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565b3e3-6cba-45e9-88f3-edf5563bd27c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:03.881722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565b3e3-6cba-45e9-88f3-edf5563bd27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:03.959192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2565b3e3-6cba-45e9-88f3-edf5563bd27c None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:03.960382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2565b3e3-6cba-45e9-88f3-edf5563bd27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:04.069200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 678/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:34:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:07.548349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3083c-4606-4511-8b43-2f1f66381a4a None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:07.549394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3083c-4606-4511-8b43-2f1f66381a4a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:07.549757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3083c-4606-4511-8b43-2f1f66381a4a None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:07.551347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 678/1356] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:07.557546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc97f6-b73b-4389-af7f-34ae5b445ba8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:07.558028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc97f6-b73b-4389-af7f-34ae5b445ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:07.558122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc97f6-b73b-4389-af7f-34ae5b445ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:07.602185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:07.638560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-17cc97f6-b73b-4389-af7f-34ae5b445ba8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:07.640133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-17cc97f6-b73b-4389-af7f-34ae5b445ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:07.763976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 679/1357] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:08.067861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c367c-5f25-4cbd-ab96-7f3017b9c481 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:08.069137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c367c-5f25-4cbd-ab96-7f3017b9c481 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:08.069614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c367c-5f25-4cbd-ab96-7f3017b9c481 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:08.071554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 679/1358] 10.222.0.67 () {54 vars in 962 bytes} [Mon Aug 29 23:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:08.079053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bcbb3-cc3a-4da2-8329-42d681d3e720 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:08.079470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bcbb3-cc3a-4da2-8329-42d681d3e720 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:08.079841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9bcbb3-cc3a-4da2-8329-42d681d3e720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:08.199016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6e9bcbb3-cc3a-4da2-8329-42d681d3e720 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:08.200333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e9bcbb3-cc3a-4da2-8329-42d681d3e720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:08.255947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:08.331327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 680/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Aug 29 23:34:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:08.339822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c367c-5f25-4cbd-ab96-7f3017b9c481 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:08.341956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c63c367c-5f25-4cbd-ab96-7f3017b9c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:08.523445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c367c-5f25-4cbd-ab96-7f3017b9c481 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:08.608667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:08.654594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:08.655216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:08.655484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:08.655752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:08.657417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:08.755300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:08.757876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc0c78-aade-41e8-bffe-487a964fb64d service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:08.779848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 680/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:10.970754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19be3-41bf-4418-a565-ecb7a2129f96 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:10.971323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19be3-41bf-4418-a565-ecb7a2129f96 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:10.971323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da19be3-41bf-4418-a565-ecb7a2129f96 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:10.972818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 681/1361] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:10.978461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87cf6-2dca-4a01-a066-cd286d0bec0b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:10.979241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87cf6-2dca-4a01-a066-cd286d0bec0b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:10.979519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f87cf6-2dca-4a01-a066-cd286d0bec0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:11.053661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-87f87cf6-2dca-4a01-a066-cd286d0bec0b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:11.054880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-87f87cf6-2dca-4a01-a066-cd286d0bec0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:11.097561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:11.176346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 681/1362] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:11.475200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19be3-41bf-4418-a565-ecb7a2129f96 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:11.477018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4da19be3-41bf-4418-a565-ecb7a2129f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:11.643323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da19be3-41bf-4418-a565-ecb7a2129f96 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:11.653641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:11.773461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:11.774223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:11.774507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:11.774780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:11.776406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:11.889881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:11.891636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a197ba8-4209-4aa7-b72a-4012d01dd992 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:11.912679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 682/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:14.163082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ee839-eaeb-4e1b-8b64-66db223d2916 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:14.163636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ee839-eaeb-4e1b-8b64-66db223d2916 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:14.163636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ee839-eaeb-4e1b-8b64-66db223d2916 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:14.164967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 682/1364] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:14.170342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fbada-7914-4214-b645-6abda64fd540 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:14.171459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fbada-7914-4214-b645-6abda64fd540 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:14.171459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478fbada-7914-4214-b645-6abda64fd540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:14.188414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:14.247936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-478fbada-7914-4214-b645-6abda64fd540 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:14.249320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-478fbada-7914-4214-b645-6abda64fd540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:14.360022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 683/1365] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:14.649636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984703a-9d79-4dd3-9cd4-2a4daea39829 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:14.649919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984703a-9d79-4dd3-9cd4-2a4daea39829 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:14.650196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0984703a-9d79-4dd3-9cd4-2a4daea39829 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:14.651515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 683/1366] 10.222.0.67 () {54 vars in 962 bytes} [Mon Aug 29 23:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:14.657480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b19876-14ea-49a3-8103-b234ff1efb00 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:14.657763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b19876-14ea-49a3-8103-b234ff1efb00 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:14.658032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b19876-14ea-49a3-8103-b234ff1efb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:14.737672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d9b19876-14ea-49a3-8103-b234ff1efb00 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:14.738871 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9b19876-14ea-49a3-8103-b234ff1efb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:14.776144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:14.874152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 684/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Aug 29 23:34:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:14.883465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984703a-9d79-4dd3-9cd4-2a4daea39829 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:14.886336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0984703a-9d79-4dd3-9cd4-2a4daea39829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:15.055503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0984703a-9d79-4dd3-9cd4-2a4daea39829 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:15.076903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:15.188280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:15.189189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:15.189631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:15.190014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:15.193193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:15.301990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:15.303768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14107b-a921-47fe-9f93-418bf763ad09 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:15.323398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 684/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:15.816934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de80d8-f639-499c-8253-a844f6c62335 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:15.817497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de80d8-f639-499c-8253-a844f6c62335 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:15.817497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de80d8-f639-499c-8253-a844f6c62335 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:15.818989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 685/1369] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:15.824094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c62e5-8146-4f92-9fdd-83202161c9e2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:15.824393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c62e5-8146-4f92-9fdd-83202161c9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:15.824660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c62e5-8146-4f92-9fdd-83202161c9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:15.859453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:15.898157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-044c62e5-8146-4f92-9fdd-83202161c9e2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:15.899380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-044c62e5-8146-4f92-9fdd-83202161c9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:16.004577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 685/1370] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:16.602667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ef5c-c6a6-4227-ade5-8af25064a593 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:16.602667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ef5c-c6a6-4227-ade5-8af25064a593 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:16.602970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8ef5c-c6a6-4227-ade5-8af25064a593 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:16.604393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 686/1371] 10.222.0.67 () {54 vars in 964 bytes} [Mon Aug 29 23:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:16.609224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d971d-424f-4f64-862c-3b5466645652 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:16.609809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d971d-424f-4f64-862c-3b5466645652 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:16.609956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d971d-424f-4f64-862c-3b5466645652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:16.689944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ab4d971d-424f-4f64-862c-3b5466645652 None None] MFA Rules not processed for user `573e64b25ae04a47aa757ba787fc850e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:16.691184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ab4d971d-424f-4f64-862c-3b5466645652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:16.741603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:16.776133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 686/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Mon Aug 29 23:34:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:16.783716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8ef5c-c6a6-4227-ade5-8af25064a593 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:16.785244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-92d8ef5c-c6a6-4227-ade5-8af25064a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:16.900586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8ef5c-c6a6-4227-ade5-8af25064a593 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:16.946514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:16.989309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:16.990227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:16.990542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:16.990771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:16.992402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:17.154682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:17.156012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d59fe-5e10-4578-9236-4b2ceba859ec service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:17.194624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 687/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:17.351538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efce9a-1691-46e4-8023-0c578313b827 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:17.351818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efce9a-1691-46e4-8023-0c578313b827 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:17.352090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efce9a-1691-46e4-8023-0c578313b827 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:17.353469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 687/1374] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:17.358822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4ebc-eebd-46af-80f3-640467784463 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:17.359132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4ebc-eebd-46af-80f3-640467784463 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:17.359373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4ebc-eebd-46af-80f3-640467784463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:17.428804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-59ba4ebc-eebd-46af-80f3-640467784463 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:17.430015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-59ba4ebc-eebd-46af-80f3-640467784463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:17.451154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:17.531357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 688/1375] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:34:17.830277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efce9a-1691-46e4-8023-0c578313b827 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:17.831815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-04efce9a-1691-46e4-8023-0c578313b827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:18.010110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efce9a-1691-46e4-8023-0c578313b827 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:18.062419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:18.129018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:18.129752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:18.130026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:18.130290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:18.132510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:18.225416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:18.227018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098e68a-f83b-4837-be78-53624afbaa39 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:18.246058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 688/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:20.201912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ea0d-a2b6-44e6-8a06-390b0d8c82bf None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:20.202480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ea0d-a2b6-44e6-8a06-390b0d8c82bf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:20.202480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648ea0d-a2b6-44e6-8a06-390b0d8c82bf None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:20.203826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 689/1377] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:20.209204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab4b5-06e1-4503-b7ba-83430a05d98f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:20.209657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab4b5-06e1-4503-b7ba-83430a05d98f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:20.209841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dab4b5-06e1-4503-b7ba-83430a05d98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:20.288649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-94dab4b5-06e1-4503-b7ba-83430a05d98f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:20.289911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-94dab4b5-06e1-4503-b7ba-83430a05d98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:20.296572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:20.420019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 689/1378] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:20.713927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648ea0d-a2b6-44e6-8a06-390b0d8c82bf None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:20.715486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7648ea0d-a2b6-44e6-8a06-390b0d8c82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:20.904418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648ea0d-a2b6-44e6-8a06-390b0d8c82bf None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:20.909063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:21.032446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:21.033081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:21.033457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:21.033737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:21.035342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:21.133720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:21.135355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13049b6f-0c80-41f7-b587-b08c8edc1df1 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:21.160744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 690/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:23.155675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c000-7ae5-4a1d-85ea-ba964e91d829 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:23.156191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c000-7ae5-4a1d-85ea-ba964e91d829 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:23.156191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c000-7ae5-4a1d-85ea-ba964e91d829 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:23.157751 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 690/1380] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:23.162903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da588e-e8d5-494a-a096-718b27bf07f4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:23.163430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da588e-e8d5-494a-a096-718b27bf07f4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:23.163430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da588e-e8d5-494a-a096-718b27bf07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:23.175457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:23.241441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-40da588e-e8d5-494a-a096-718b27bf07f4 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:23.242631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-40da588e-e8d5-494a-a096-718b27bf07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:23.344815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 691/1381] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:34:23.635661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c000-7ae5-4a1d-85ea-ba964e91d829 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:23.637306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-92a0c000-7ae5-4a1d-85ea-ba964e91d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:23.794238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:23.805908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c000-7ae5-4a1d-85ea-ba964e91d829 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:23.937390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:23.937889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:23.938196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:23.938471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:23.941407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:24.049594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:24.051188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d4834-f5aa-4e97-95cf-5d458a81f2c6 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:24.062259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:24.081542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 691/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:34:26.380063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eace6-2323-430b-9f73-e9b9b4f8bc9a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:26.380651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eace6-2323-430b-9f73-e9b9b4f8bc9a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:26.380755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9eace6-2323-430b-9f73-e9b9b4f8bc9a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:26.382567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 692/1383] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:26.388943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff510-3713-4e29-9166-0817ffc622b9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:26.389410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff510-3713-4e29-9166-0817ffc622b9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:26.389525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ff510-3713-4e29-9166-0817ffc622b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:26.467124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ce2ff510-3713-4e29-9166-0817ffc622b9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:26.468271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ce2ff510-3713-4e29-9166-0817ffc622b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:26.572555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 692/1384] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:26.880496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eace6-2323-430b-9f73-e9b9b4f8bc9a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:26.882072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bf9eace6-2323-430b-9f73-e9b9b4f8bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:26.990360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:27.069369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9eace6-2323-430b-9f73-e9b9b4f8bc9a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:27.214155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:27.215038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:27.215460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:27.215798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:27.217907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:27.276805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:27.321073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:27.322918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19b9fc-1b06-4b59-9341-06413fd02d55 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:27.343479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 693/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:29.939845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba16f06-efd8-419d-ab97-5b8ac4c39125 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:29.940423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba16f06-efd8-419d-ab97-5b8ac4c39125 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:29.940423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba16f06-efd8-419d-ab97-5b8ac4c39125 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:29.941810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 693/1386] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:34:29.949106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020c15-adcf-439b-aa98-3e17228c9d5a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:29.949620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020c15-adcf-439b-aa98-3e17228c9d5a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:29.949899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95020c15-adcf-439b-aa98-3e17228c9d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:30.026050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-95020c15-adcf-439b-aa98-3e17228c9d5a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:30.027324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-95020c15-adcf-439b-aa98-3e17228c9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:30.138047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 694/1387] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:30.451957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba16f06-efd8-419d-ab97-5b8ac4c39125 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:30.453871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fba16f06-efd8-419d-ab97-5b8ac4c39125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:30.539781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:30.651763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba16f06-efd8-419d-ab97-5b8ac4c39125 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:30.772409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:30.773124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:30.773435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:30.773709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:30.775329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:30.815547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:30.868764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:30.870412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f76321-c931-4230-ae25-a8639903b176 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:30.903416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 694/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:32.533376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2a434-5d35-4304-b2f6-0cfbd4becb35 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:32.533924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2a434-5d35-4304-b2f6-0cfbd4becb35 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:32.533924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2a434-5d35-4304-b2f6-0cfbd4becb35 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:32.535192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 695/1389] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:32.540401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032ffa-4593-47ac-8887-b0f1c25b0977 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:32.540835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032ffa-4593-47ac-8887-b0f1c25b0977 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:32.540961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb032ffa-4593-47ac-8887-b0f1c25b0977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:32.609507 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bb032ffa-4593-47ac-8887-b0f1c25b0977 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:32.610724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bb032ffa-4593-47ac-8887-b0f1c25b0977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:32.714243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 695/1390] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:32.825103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16537-3cc4-42e5-b47a-f99cea817dcb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:32.825290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16537-3cc4-42e5-b47a-f99cea817dcb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:32.825634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16537-3cc4-42e5-b47a-f99cea817dcb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:32.827000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 696/1391] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:32.832503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a55e78-7f96-4620-a9c5-520d39e4d004 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:32.832838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a55e78-7f96-4620-a9c5-520d39e4d004 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:32.833118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a55e78-7f96-4620-a9c5-520d39e4d004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:32.849266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:32.902228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-99a55e78-7f96-4620-a9c5-520d39e4d004 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:32.903437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-99a55e78-7f96-4620-a9c5-520d39e4d004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:33.016576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 696/1392] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:33.025566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ac9-b8f5-4812-a6a4-ba6e1e1118f2 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:33.025847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ac9-b8f5-4812-a6a4-ba6e1e1118f2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:33.026119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03835ac9-b8f5-4812-a6a4-ba6e1e1118f2 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:33.027423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 697/1393] 10.222.0.67 () {54 vars in 967 bytes} [Mon Aug 29 23:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:33.032361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:33.032647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:33.032917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:33.110754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] MFA Rules not processed for user `2b8d3f2d7323411d81303f472a16d562`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:33.111964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:33.147134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:33.191492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 697/1394] 10.222.0.67 () {58 vars in 1064 bytes} [Mon Aug 29 23:34:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:34:33.199100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835ac9-b8f5-4812-a6a4-ba6e1e1118f2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:33.200636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-03835ac9-b8f5-4812-a6a4-ba6e1e1118f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:33.234013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:33.308384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:33.309643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:33.314917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03835ac9-b8f5-4812-a6a4-ba6e1e1118f2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:33.405528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:33.406433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:33.406708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:33.406976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:33.408567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:33.447706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834b02a-d589-4d79-9a1b-c8d92fafc0de None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:33.487504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:33.512342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:33.524949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:33.526445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb41df-04e9-43ad-a6e9-52d99dc571c8 service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:33.544930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 698/1395] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:33.564733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:33.565335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:33.565638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:33.565908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:33.568018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:33.657754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:33.659263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402474e4-3418-4edd-ac8e-908060af1c65 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:33.677710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 698/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:34.297212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024bdb6-0932-4fc4-b3f1-da864f5c8719 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:34.297554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024bdb6-0932-4fc4-b3f1-da864f5c8719 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:34.297831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024bdb6-0932-4fc4-b3f1-da864f5c8719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:34.370690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2024bdb6-0932-4fc4-b3f1-da864f5c8719 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:34.371927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2024bdb6-0932-4fc4-b3f1-da864f5c8719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:34.462621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 699/1397] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:34:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:34.507160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009d90-2822-4b38-9da3-1db158f6ecf0 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:34.507463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009d90-2822-4b38-9da3-1db158f6ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:34.507735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77009d90-2822-4b38-9da3-1db158f6ecf0 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:34.509082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 699/1398] 10.222.0.67 () {54 vars in 943 bytes} [Mon Aug 29 23:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:34.515408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6ee5-d6e0-4f57-bc0c-128c72924998 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:34.515696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6ee5-d6e0-4f57-bc0c-128c72924998 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:34.515970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a6ee5-d6e0-4f57-bc0c-128c72924998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:34.574260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:34.596491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-759a6ee5-d6e0-4f57-bc0c-128c72924998 None None] MFA Rules not processed for user `8c13a2711f2f4a0dbbc312b7a1b9034b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:34.597801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-759a6ee5-d6e0-4f57-bc0c-128c72924998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:34.712755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 700/1399] 10.222.0.67 () {58 vars in 1040 bytes} [Mon Aug 29 23:34:34 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:34:34.722124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009d90-2822-4b38-9da3-1db158f6ecf0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:34.724207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-77009d90-2822-4b38-9da3-1db158f6ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:34.804445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:34.865920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77009d90-2822-4b38-9da3-1db158f6ecf0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:34.968394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:34.969031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:34.969267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:34.969560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:34.971177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:35.030899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:35.053600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:35.055200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fddf70-90be-46ee-bc5a-ccd113c7f730 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:35.063500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 700/1400] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:34:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:34:35.689015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634975d2-bcea-4dd0-96ea-7b1d1e16f135 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:35.689701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634975d2-bcea-4dd0-96ea-7b1d1e16f135 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:35.689701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634975d2-bcea-4dd0-96ea-7b1d1e16f135 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:35.690953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 701/1401] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:35.696921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42959bd-9b89-4a46-b5b8-5f1ba1b86fc5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:35.697214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42959bd-9b89-4a46-b5b8-5f1ba1b86fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:35.697530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42959bd-9b89-4a46-b5b8-5f1ba1b86fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:35.777300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c42959bd-9b89-4a46-b5b8-5f1ba1b86fc5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:35.778725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c42959bd-9b89-4a46-b5b8-5f1ba1b86fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:35.892412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 701/1402] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:36.191419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634975d2-bcea-4dd0-96ea-7b1d1e16f135 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:36.193279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-634975d2-bcea-4dd0-96ea-7b1d1e16f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:36.308205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:36.363643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634975d2-bcea-4dd0-96ea-7b1d1e16f135 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:36.501964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:36.502486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:36.502767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:36.503033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:36.504664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:36.583783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:36.607603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:36.609378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b4093-e047-48a5-bddd-50ae90221bad service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:36.629021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 702/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:38.634096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e55d4-90b7-47f0-a856-e3a823619648 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:38.634658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e55d4-90b7-47f0-a856-e3a823619648 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:38.634658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e55d4-90b7-47f0-a856-e3a823619648 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:38.636123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 702/1404] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:38.641887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5c1b3-fb60-4831-ad49-aaf220a105f5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:38.641887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5c1b3-fb60-4831-ad49-aaf220a105f5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:38.641887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5c1b3-fb60-4831-ad49-aaf220a105f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:38.739356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b6a5c1b3-fb60-4831-ad49-aaf220a105f5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:38.740587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b6a5c1b3-fb60-4831-ad49-aaf220a105f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:38.864156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 703/1405] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:39.178693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e55d4-90b7-47f0-a856-e3a823619648 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:39.180278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6e3e55d4-90b7-47f0-a856-e3a823619648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:39.262380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:39.399322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e55d4-90b7-47f0-a856-e3a823619648 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:39.535519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:39.537039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:39.538159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:39.538428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:39.540068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:39.558300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:39.644629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:39.646318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eab479-6abf-4185-ba67-67e338d48680 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:39.666375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 703/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:34:41.627557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9635905-9e5c-4255-b22d-3b96015fe793 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:41.628117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9635905-9e5c-4255-b22d-3b96015fe793 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:41.628117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9635905-9e5c-4255-b22d-3b96015fe793 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:41.633228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 704/1407] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:34:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:41.634626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf283ed-cead-4bdf-a903-c89160f693ad None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:41.635036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf283ed-cead-4bdf-a903-c89160f693ad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:41.635183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf283ed-cead-4bdf-a903-c89160f693ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:41.714628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ddf283ed-cead-4bdf-a903-c89160f693ad None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:41.716159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ddf283ed-cead-4bdf-a903-c89160f693ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:41.806388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:41.820073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 704/1408] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:34:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:34:42.110488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9635905-9e5c-4255-b22d-3b96015fe793 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:34:42.112013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b9635905-9e5c-4255-b22d-3b96015fe793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:42.177743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:42.286619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9635905-9e5c-4255-b22d-3b96015fe793 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:34:42.422035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:34:42.422651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:42.422930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:42.423203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:42.424952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:42.437640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:42.549298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:34:42.550967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c5b11-1f9b-4dd2-9278-f4ea06831022 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:34:42.571290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 705/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:34:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:34:51.818396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:52.568959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=42 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:57.423938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c703cc-9d91-4f6a-8cf7-b15f942253c6 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:57.424471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c703cc-9d91-4f6a-8cf7-b15f942253c6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:57.424471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c703cc-9d91-4f6a-8cf7-b15f942253c6 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:57.426432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 705/1410] 10.222.0.67 () {54 vars in 918 bytes} [Mon Aug 29 23:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:57.431633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4eca-47a1-45a0-bb4b-8fb6191a0bdf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:57.432055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4eca-47a1-45a0-bb4b-8fb6191a0bdf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:57.432163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c4eca-47a1-45a0-bb4b-8fb6191a0bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:57.508948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-db4c4eca-47a1-45a0-bb4b-8fb6191a0bdf None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:57.510200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-db4c4eca-47a1-45a0-bb4b-8fb6191a0bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:57.617492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 706/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Aug 29 23:34:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:34:57.632128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad616c6-f649-4c8b-af24-ddcda2aa3cec None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:57.632414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad616c6-f649-4c8b-af24-ddcda2aa3cec None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:57.632688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad616c6-f649-4c8b-af24-ddcda2aa3cec None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:57.634050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 706/1412] 10.222.0.67 () {54 vars in 918 bytes} [Mon Aug 29 23:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:34:57.638790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9891d47-830f-4a61-980f-4e582b06df36 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:34:57.639073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9891d47-830f-4a61-980f-4e582b06df36 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:34:57.639345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9891d47-830f-4a61-980f-4e582b06df36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:34:57.713031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:34:57.716074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e9891d47-830f-4a61-980f-4e582b06df36 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:34:57.717861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9891d47-830f-4a61-980f-4e582b06df36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:34:57.840355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 707/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Aug 29 23:34:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:00.234337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b01e84-2160-4bb8-8759-bfcf0f27477f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:00.234876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b01e84-2160-4bb8-8759-bfcf0f27477f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:00.234876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b01e84-2160-4bb8-8759-bfcf0f27477f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:00.236263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:00.241716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3384ba-0996-4c95-af50-967747efcec5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:00.242143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3384ba-0996-4c95-af50-967747efcec5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:00.242254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3384ba-0996-4c95-af50-967747efcec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:00.308398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-da3384ba-0996-4c95-af50-967747efcec5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:00.309618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-da3384ba-0996-4c95-af50-967747efcec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:00.366490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:00.409404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:00.703339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b01e84-2160-4bb8-8759-bfcf0f27477f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:00.705008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-46b01e84-2160-4bb8-8759-bfcf0f27477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:00.850824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b01e84-2160-4bb8-8759-bfcf0f27477f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:00.924788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:00.965565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:00.966168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:00.966447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:00.966714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:00.968324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:01.057027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:01.058654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a78c2d-0671-432c-8ff1-1c36612a1c04 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:01.077329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 708/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:01.980253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fc45b-863c-408c-bde3-bf7e09e055ab None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:01.980828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fc45b-863c-408c-bde3-bf7e09e055ab None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:01.980828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fc45b-863c-408c-bde3-bf7e09e055ab None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:01.982177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:01.987000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8797f-8083-4889-a922-c06d26cf1436 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:01.987438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8797f-8083-4889-a922-c06d26cf1436 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:01.987550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8797f-8083-4889-a922-c06d26cf1436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:02.064014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bef8797f-8083-4889-a922-c06d26cf1436 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:02.065228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bef8797f-8083-4889-a922-c06d26cf1436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:02.093484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:02.163375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:02.316840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fc45b-863c-408c-bde3-bf7e09e055ab None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:02.318923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d76fc45b-863c-408c-bde3-bf7e09e055ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:02.465600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fc45b-863c-408c-bde3-bf7e09e055ab None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:02.505841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:02.583887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:02.584523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:02.584794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:02.585057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:02.587351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:02.679870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:02.681503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920d3aaf-4583-45ac-be9f-05a93c22f1a3 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:02.699433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 710/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:03.576234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208e65-4e2d-4861-99c2-6265c20193f6 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:03.576791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208e65-4e2d-4861-99c2-6265c20193f6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:03.576791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e208e65-4e2d-4861-99c2-6265c20193f6 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:03.578098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:03.583541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c025e2-811a-4863-8b0c-8941f3c333db None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:03.583996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c025e2-811a-4863-8b0c-8941f3c333db None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:03.584099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c025e2-811a-4863-8b0c-8941f3c333db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:03.641630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:03.666170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d5c025e2-811a-4863-8b0c-8941f3c333db None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:03.667363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d5c025e2-811a-4863-8b0c-8941f3c333db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:03.768724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:35:03.924905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208e65-4e2d-4861-99c2-6265c20193f6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:03.926522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8e208e65-4e2d-4861-99c2-6265c20193f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:04.071654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e208e65-4e2d-4861-99c2-6265c20193f6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:04.084287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:04.187386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:04.187917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:04.188196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:04.188466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:04.190089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:04.289538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:04.291151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4aaf5-76cb-4896-b6dd-58db5e94a3bb service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:04.309019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 711/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:05.176182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5545b9f-b958-4b23-b6a5-c7ed06265b27 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:05.176843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5545b9f-b958-4b23-b6a5-c7ed06265b27 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:05.176843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5545b9f-b958-4b23-b6a5-c7ed06265b27 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:05.178150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:05.183149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f44b3-273d-433f-ad69-49c99a9d2445 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:05.183643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f44b3-273d-433f-ad69-49c99a9d2445 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:05.183728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f44b3-273d-433f-ad69-49c99a9d2445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:05.204288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:05.269986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d59f44b3-273d-433f-ad69-49c99a9d2445 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:05.271239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d59f44b3-273d-433f-ad69-49c99a9d2445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:05.377753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:05.533750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5545b9f-b958-4b23-b6a5-c7ed06265b27 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:05.535896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d5545b9f-b958-4b23-b6a5-c7ed06265b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:05.651870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:05.688130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5545b9f-b958-4b23-b6a5-c7ed06265b27 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:05.804246 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:05.804768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:05.805050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:05.805325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:05.806983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:05.888863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:05.902991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:05.904581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626bcc8-c864-45ae-865e-cd0d963616a8 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:05.922576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 713/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:35:06.790884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d350b83-1dd3-4bca-b12d-b8c584ab874e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:06.791457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d350b83-1dd3-4bca-b12d-b8c584ab874e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:06.791457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d350b83-1dd3-4bca-b12d-b8c584ab874e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:06.792780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:06.797793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18f22-decd-4e69-a1c1-bad00f09bd26 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:06.798247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18f22-decd-4e69-a1c1-bad00f09bd26 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:06.798377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18f22-decd-4e69-a1c1-bad00f09bd26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:06.875150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-53f18f22-decd-4e69-a1c1-bad00f09bd26 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:06.876367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-53f18f22-decd-4e69-a1c1-bad00f09bd26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:06.976117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:07.125428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d350b83-1dd3-4bca-b12d-b8c584ab874e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:07.126864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6d350b83-1dd3-4bca-b12d-b8c584ab874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:07.212506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:07.274417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d350b83-1dd3-4bca-b12d-b8c584ab874e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:07.385777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:07.386292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:07.386564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:07.386832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:07.388705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:07.437194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:07.483698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:07.485696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3f546-f09b-4e4a-9724-201b864de92f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:07.504833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 714/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:08.304804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061dc3a-58ef-4f95-ad74-b68c5b77a2d5 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:08.305415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061dc3a-58ef-4f95-ad74-b68c5b77a2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:08.305415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061dc3a-58ef-4f95-ad74-b68c5b77a2d5 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:08.306803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:08.311909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fb4d3-da00-425c-b5bb-767c65f1a8bb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:08.312362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fb4d3-da00-425c-b5bb-767c65f1a8bb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:08.312457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fb4d3-da00-425c-b5bb-767c65f1a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:08.390978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-633fb4d3-da00-425c-b5bb-767c65f1a8bb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:08.392214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-633fb4d3-da00-425c-b5bb-767c65f1a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:08.489451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:08.640642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061dc3a-58ef-4f95-ad74-b68c5b77a2d5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:08.642197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8061dc3a-58ef-4f95-ad74-b68c5b77a2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:08.691357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:08.803624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061dc3a-58ef-4f95-ad74-b68c5b77a2d5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:08.921773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:08.922387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:08.922656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:08.922920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:08.924507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:08.932105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:09.019869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:09.021540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211424a-23a1-4522-bfa1-b3b340950730 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:09.039935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 716/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:09.867672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e808e7-e6c7-4c5d-8c26-32b77f9f1878 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:09.868254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e808e7-e6c7-4c5d-8c26-32b77f9f1878 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:09.868354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e808e7-e6c7-4c5d-8c26-32b77f9f1878 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:09.869756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:09.874995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c999-2f9f-4ebe-8f02-6d5733fc5879 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:09.875455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c999-2f9f-4ebe-8f02-6d5733fc5879 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:09.875558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0571c999-2f9f-4ebe-8f02-6d5733fc5879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:09.970662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0571c999-2f9f-4ebe-8f02-6d5733fc5879 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:09.972512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0571c999-2f9f-4ebe-8f02-6d5733fc5879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:10.045638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:10.076146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:10.227759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e808e7-e6c7-4c5d-8c26-32b77f9f1878 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:10.229313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-93e808e7-e6c7-4c5d-8c26-32b77f9f1878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:10.254374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:10.397310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e808e7-e6c7-4c5d-8c26-32b77f9f1878 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:10.495750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:10.523470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:10.524082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:10.524364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:10.524636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:10.526317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:10.652016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:10.653661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a945b1-bb2e-4b23-902a-05254dc43c36 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:10.671408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 717/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:11.479684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4bf6a-d1d3-4ba2-874d-82c42267ceca None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:11.480226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4bf6a-d1d3-4ba2-874d-82c42267ceca None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:11.480226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4bf6a-d1d3-4ba2-874d-82c42267ceca None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:11.481494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:11.486509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7927f3-0aa3-49de-946c-393557710c06 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:11.486986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7927f3-0aa3-49de-946c-393557710c06 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:11.487105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7927f3-0aa3-49de-946c-393557710c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:11.564433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5e7927f3-0aa3-49de-946c-393557710c06 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:11.566260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5e7927f3-0aa3-49de-946c-393557710c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:11.608135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:11.663446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:11.812989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4bf6a-d1d3-4ba2-874d-82c42267ceca None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:11.814522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-42a4bf6a-d1d3-4ba2-874d-82c42267ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:11.962671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4bf6a-d1d3-4ba2-874d-82c42267ceca None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:12.016606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:12.075929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:12.076453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:12.076732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:12.077000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:12.078642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:12.169524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:12.171122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce1509-d17b-4ac8-89e5-ec0cb6f85d34 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:12.189268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 719/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:13.000078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d70bb-e5ca-4a5c-aa78-fe56b5f11f7b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:13.000613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d70bb-e5ca-4a5c-aa78-fe56b5f11f7b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:13.000613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d70bb-e5ca-4a5c-aa78-fe56b5f11f7b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:13.001920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:13.007614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9b13-8074-42cd-a447-bf638583bbff None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:13.008036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9b13-8074-42cd-a447-bf638583bbff None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:13.008146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec9b13-8074-42cd-a447-bf638583bbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:13.088855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-89ec9b13-8074-42cd-a447-bf638583bbff None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:13.090096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-89ec9b13-8074-42cd-a447-bf638583bbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:13.092116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:13.189522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:35:13.345709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d70bb-e5ca-4a5c-aa78-fe56b5f11f7b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:13.347682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b17d70bb-e5ca-4a5c-aa78-fe56b5f11f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:13.495373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d70bb-e5ca-4a5c-aa78-fe56b5f11f7b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:13.522320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:13.609921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:13.610529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:13.610806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:13.611075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:13.612705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:13.701989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:13.703580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58a269-0fb1-4445-9dfc-c67ced290392 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:13.721838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 720/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:15.557207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f24e9-bab7-4541-baa5-04cbe29fb768 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:15.557785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f24e9-bab7-4541-baa5-04cbe29fb768 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:15.557785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f24e9-bab7-4541-baa5-04cbe29fb768 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:15.559019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:15.564227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c69c2e-04df-487b-930f-d0b737c711b8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:15.564657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c69c2e-04df-487b-930f-d0b737c711b8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:15.564767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c69c2e-04df-487b-930f-d0b737c711b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:15.606075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:15.633153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-32c69c2e-04df-487b-930f-d0b737c711b8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:15.634390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-32c69c2e-04df-487b-930f-d0b737c711b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:15.730613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:16.015263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f24e9-bab7-4541-baa5-04cbe29fb768 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:16.016828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-864f24e9-bab7-4541-baa5-04cbe29fb768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:16.121123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f24e9-bab7-4541-baa5-04cbe29fb768 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:16.153196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:16.197099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:16.197736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:16.198018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:16.198294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:16.199906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:16.309371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:16.310742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895c351-cfd5-4f8d-9b7b-6a6e01332f42 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:16.328806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 722/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:18.417545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21471-04cb-4a7f-824d-464019f5d186 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:18.418095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21471-04cb-4a7f-824d-464019f5d186 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:18.418095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f21471-04cb-4a7f-824d-464019f5d186 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:18.419425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:35:18.424767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36153255-a8be-42bf-89c8-fff28c0bb160 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:18.425204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36153255-a8be-42bf-89c8-fff28c0bb160 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:18.425453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36153255-a8be-42bf-89c8-fff28c0bb160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:18.493278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-36153255-a8be-42bf-89c8-fff28c0bb160 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:18.494503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-36153255-a8be-42bf-89c8-fff28c0bb160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:18.508043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:18.594459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:35:18.887899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21471-04cb-4a7f-824d-464019f5d186 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:18.889465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-11f21471-04cb-4a7f-824d-464019f5d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:18.996003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f21471-04cb-4a7f-824d-464019f5d186 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:19.009207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:19.071490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:19.072096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:19.072373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:19.072641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:19.074464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:19.182716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:19.184153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecf76e-6bd9-409c-a88e-5272e35aeb61 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:19.201757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 723/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:21.445584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f7a61-52d8-408f-8e25-56c81b01bad6 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:21.446100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f7a61-52d8-408f-8e25-56c81b01bad6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:21.446100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f7a61-52d8-408f-8e25-56c81b01bad6 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:21.447382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:21.452776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daffa0-2e16-40a5-a86e-c636b7aa95d7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:21.453239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daffa0-2e16-40a5-a86e-c636b7aa95d7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:21.453371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daffa0-2e16-40a5-a86e-c636b7aa95d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:21.501622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:21.521693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-71daffa0-2e16-40a5-a86e-c636b7aa95d7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:21.522893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-71daffa0-2e16-40a5-a86e-c636b7aa95d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:21.618587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:21.906561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f7a61-52d8-408f-8e25-56c81b01bad6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:21.908123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-254f7a61-52d8-408f-8e25-56c81b01bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:22.013238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f7a61-52d8-408f-8e25-56c81b01bad6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:22.053818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:22.088825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:22.089457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:22.089754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:22.090005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:22.091614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:22.201403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:22.202935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82bf8c-8ae4-45dd-817f-e5e15ffbaf64 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:22.222751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 725/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:24.253852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fe739-6d44-4f4b-b74f-1e6cb471104f None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:24.254411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fe739-6d44-4f4b-b74f-1e6cb471104f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:24.254411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fe739-6d44-4f4b-b74f-1e6cb471104f None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:24.255757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:24.260945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee7e2-614e-45ec-a3ab-47ee746cecce None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:24.261476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee7e2-614e-45ec-a3ab-47ee746cecce None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:24.261598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aee7e2-614e-45ec-a3ab-47ee746cecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:24.329968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-68aee7e2-614e-45ec-a3ab-47ee746cecce None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:24.331193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-68aee7e2-614e-45ec-a3ab-47ee746cecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:24.351973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:24.429688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:24.722758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fe739-6d44-4f4b-b74f-1e6cb471104f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:24.724328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-817fe739-6d44-4f4b-b74f-1e6cb471104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:24.827642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fe739-6d44-4f4b-b74f-1e6cb471104f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:24.848938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:24.902815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:24.903419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:24.903692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:24.903962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:24.905675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:25.019674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:25.021054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d9879-12cb-4df5-ae57-47595f569f85 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:25.039400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 726/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:27.081716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d571a4-875a-4470-bb2f-c30d8a1d557f None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:27.082294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d571a4-875a-4470-bb2f-c30d8a1d557f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:27.082294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d571a4-875a-4470-bb2f-c30d8a1d557f None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:27.083526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:27.089284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37258eb7-8d0a-45d3-b8b5-57a6a5ba8c9d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:27.089791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37258eb7-8d0a-45d3-b8b5-57a6a5ba8c9d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:27.089928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37258eb7-8d0a-45d3-b8b5-57a6a5ba8c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:27.157577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:27.160680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-37258eb7-8d0a-45d3-b8b5-57a6a5ba8c9d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:27.162592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-37258eb7-8d0a-45d3-b8b5-57a6a5ba8c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:27.260927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:35:27.546830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d571a4-875a-4470-bb2f-c30d8a1d557f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:27.548458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-76d571a4-875a-4470-bb2f-c30d8a1d557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:27.655685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d571a4-875a-4470-bb2f-c30d8a1d557f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:27.705264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:27.730886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:27.731520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:27.731785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:27.732050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:27.733672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:27.842804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:27.844174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965827-53f2-496b-becf-1f78571da271 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:27.862545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 728/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:29.886838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a19b0-7a15-4c98-8199-81124dc9b2bb None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:29.887391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a19b0-7a15-4c98-8199-81124dc9b2bb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:29.887391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a19b0-7a15-4c98-8199-81124dc9b2bb None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:29.888724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:29.894606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d74e1-5fea-4e62-b701-bee45a4d8b4c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:29.895046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d74e1-5fea-4e62-b701-bee45a4d8b4c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:29.895141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d74e1-5fea-4e62-b701-bee45a4d8b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:29.961855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-720d74e1-5fea-4e62-b701-bee45a4d8b4c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:29.963068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-720d74e1-5fea-4e62-b701-bee45a4d8b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:29.992437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:30.074111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:30.363188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a19b0-7a15-4c98-8199-81124dc9b2bb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:30.364850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-661a19b0-7a15-4c98-8199-81124dc9b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:30.475534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a19b0-7a15-4c98-8199-81124dc9b2bb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:30.505032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:30.550189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:30.550796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:30.551207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:30.551492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:30.553121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:30.664840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:30.666333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b219fb-5c90-4e89-a989-293e40667bc9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:30.685770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 729/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:32.693248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c6532-a41e-4bcf-8535-cdbd7abf1f30 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:32.693849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c6532-a41e-4bcf-8535-cdbd7abf1f30 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:32.693849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c6532-a41e-4bcf-8535-cdbd7abf1f30 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:32.695241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:32.700459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ceb3-12ed-4b2d-a1ec-3501ec5610ad None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:32.700891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ceb3-12ed-4b2d-a1ec-3501ec5610ad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:32.700994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9ceb3-12ed-4b2d-a1ec-3501ec5610ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:32.769893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6fc9ceb3-12ed-4b2d-a1ec-3501ec5610ad None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:32.771107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fc9ceb3-12ed-4b2d-a1ec-3501ec5610ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:32.779477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:32.872231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:33.155211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c6532-a41e-4bcf-8535-cdbd7abf1f30 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:33.156750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a0c6532-a41e-4bcf-8535-cdbd7abf1f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:33.260757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c6532-a41e-4bcf-8535-cdbd7abf1f30 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:33.316484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:33.335350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:33.335945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:33.336492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:33.336763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:33.338407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:33.450306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:33.452641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddeedd0-d01d-4604-9353-0d1f1e2d278e service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:33.474238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 731/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:35.451350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1ab9-b279-46a6-84ca-c0a9342e596e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:35.451875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1ab9-b279-46a6-84ca-c0a9342e596e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:35.451875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d1ab9-b279-46a6-84ca-c0a9342e596e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:35.453165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:35.458480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c59f-392a-4f72-b99f-789377e9c516 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:35.458927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c59f-392a-4f72-b99f-789377e9c516 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:35.459037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820c59f-392a-4f72-b99f-789377e9c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:35.526041 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5820c59f-392a-4f72-b99f-789377e9c516 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:35.527265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5820c59f-392a-4f72-b99f-789377e9c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:35.566999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:35.625934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:35.916813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1ab9-b279-46a6-84ca-c0a9342e596e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:35.918714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f86d1ab9-b279-46a6-84ca-c0a9342e596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:36.042793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d1ab9-b279-46a6-84ca-c0a9342e596e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:36.079623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:36.116651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:36.117253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:36.117565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:36.117832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:36.119441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:36.231373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:36.232759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfd4cb9-22e2-449f-b371-6e784ae5ce50 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:36.250481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 732/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:38.192014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d16ba-2ef1-4a11-b512-d9a4926d220c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:38.192529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d16ba-2ef1-4a11-b512-d9a4926d220c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:38.192666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d16ba-2ef1-4a11-b512-d9a4926d220c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:38.193982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:38.199437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826c29-5954-40e9-8d75-882a42daba5c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:38.199872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826c29-5954-40e9-8d75-882a42daba5c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:38.199970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73826c29-5954-40e9-8d75-882a42daba5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:38.268067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-73826c29-5954-40e9-8d75-882a42daba5c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:38.269298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-73826c29-5954-40e9-8d75-882a42daba5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:38.288160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:38.367783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:38.653915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d16ba-2ef1-4a11-b512-d9a4926d220c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:38.655511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ff0d16ba-2ef1-4a11-b512-d9a4926d220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:38.773850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d16ba-2ef1-4a11-b512-d9a4926d220c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:38.843255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:38.850585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:38.851197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:38.851473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:38.851743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:38.853361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:38.967069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:38.968469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4656ce1-71f1-439d-87a4-61edf2d243a0 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:38.987500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 734/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:40.934040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a561f4-9818-48d3-8db5-68a760ae68d5 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:40.934699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a561f4-9818-48d3-8db5-68a760ae68d5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:40.934699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a561f4-9818-48d3-8db5-68a760ae68d5 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:40.935935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:35:40.941696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68211ea8-b05a-45f8-94a7-4818a4ac1c21 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:40.942138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68211ea8-b05a-45f8-94a7-4818a4ac1c21 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:40.942236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68211ea8-b05a-45f8-94a7-4818a4ac1c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:41.013369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-68211ea8-b05a-45f8-94a7-4818a4ac1c21 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:35:41.014596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-68211ea8-b05a-45f8-94a7-4818a4ac1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:41.066672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:41.115175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:35:41.400466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a561f4-9818-48d3-8db5-68a760ae68d5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:35:41.402070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-31a561f4-9818-48d3-8db5-68a760ae68d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:41.511061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a561f4-9818-48d3-8db5-68a760ae68d5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:35:41.558178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:41.585494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:35:41.586367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:35:41.586650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:35:41.586916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:35:41.588526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:35:41.702195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:35:41.704161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308669ed-2350-4e1a-af59-fb668fbb76a1 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:35:41.732975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 735/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:35:51.113381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=22 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:35:51.730441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=66 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:01.355374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f872d1-04fd-4794-85a2-5f77708c4bdb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:01.355941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f872d1-04fd-4794-85a2-5f77708c4bdb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:01.355941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f872d1-04fd-4794-85a2-5f77708c4bdb None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:01.357252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 736/1471] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:01.362570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca686e-a66b-48f1-ad9f-3f4c21ea446e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:01.363030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca686e-a66b-48f1-ad9f-3f4c21ea446e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:01.363135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca686e-a66b-48f1-ad9f-3f4c21ea446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:01.431330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f0ca686e-a66b-48f1-ad9f-3f4c21ea446e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:01.432485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f0ca686e-a66b-48f1-ad9f-3f4c21ea446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:01.528803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 736/1472] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:01.832307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888acaf4-0442-4bbe-99c6-72724dfea33c None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:01.832591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888acaf4-0442-4bbe-99c6-72724dfea33c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:01.833054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888acaf4-0442-4bbe-99c6-72724dfea33c None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:01.834607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 737/1473] 10.222.0.67 () {54 vars in 967 bytes} [Mon Aug 29 23:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:01.839495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e323c-365b-4406-8747-3b09257cd5d9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:01.839789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e323c-365b-4406-8747-3b09257cd5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:01.840062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e323c-365b-4406-8747-3b09257cd5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:01.916138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b74e323c-365b-4406-8747-3b09257cd5d9 None None] MFA Rules not processed for user `2b8d3f2d7323411d81303f472a16d562`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:01.917377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b74e323c-365b-4406-8747-3b09257cd5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:01.938476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:01.994531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 737/1474] 10.222.0.67 () {58 vars in 1064 bytes} [Mon Aug 29 23:36:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:02.002003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888acaf4-0442-4bbe-99c6-72724dfea33c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:02.003520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-888acaf4-0442-4bbe-99c6-72724dfea33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:02.107731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888acaf4-0442-4bbe-99c6-72724dfea33c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:02.182570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:02.183178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:02.183455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:02.183731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:02.185363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:02.242162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:02.297150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:02.298644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4253e6-4d2d-439c-9bfc-6fabab28eae4 service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:02.316824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 738/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:04.297694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ce16f-c609-478c-872f-7c6fa9a74881 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:04.298650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ce16f-c609-478c-872f-7c6fa9a74881 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:04.298763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ce16f-c609-478c-872f-7c6fa9a74881 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:04.300074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 738/1476] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:04.305335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b52e-c875-42ce-b405-1297feee61ef None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:04.305843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b52e-c875-42ce-b405-1297feee61ef None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:04.305985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b52e-c875-42ce-b405-1297feee61ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:04.372072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8f58b52e-c875-42ce-b405-1297feee61ef None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:04.373260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f58b52e-c875-42ce-b405-1297feee61ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:04.471523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 739/1477] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:04.739623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ce16f-c609-478c-872f-7c6fa9a74881 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:04.741098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c50ce16f-c609-478c-872f-7c6fa9a74881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:04.868320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ce16f-c609-478c-872f-7c6fa9a74881 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:04.919524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:04.967024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:04.967628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:04.967903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:04.968169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:04.968806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:04.970619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:36:04.970619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:36:04.970619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:36:04.971745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87684dc5-531b-4829-87c6-4f6db3224f98 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:04.990511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 739/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Mon Aug 29 23:36:04 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:36:07.000192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c18c-ff07-4429-84e1-e7219b1225b1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:07.000740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c18c-ff07-4429-84e1-e7219b1225b1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:07.000740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70c18c-ff07-4429-84e1-e7219b1225b1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:07.002071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 740/1479] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:07.007243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e147e9-73a9-4bfb-93c5-3e30221fadff None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:07.007709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e147e9-73a9-4bfb-93c5-3e30221fadff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:07.007808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e147e9-73a9-4bfb-93c5-3e30221fadff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:07.075335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-65e147e9-73a9-4bfb-93c5-3e30221fadff None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:07.076550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-65e147e9-73a9-4bfb-93c5-3e30221fadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:07.173768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 740/1480] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:07.465896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c18c-ff07-4429-84e1-e7219b1225b1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:07.467434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ed70c18c-ff07-4429-84e1-e7219b1225b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:07.478063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:07.617533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70c18c-ff07-4429-84e1-e7219b1225b1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:07.696629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:07.730639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:07.731155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:07.731564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:07.731711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:07.733269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:07.824562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:07.826268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6f5f-f9e5-40ff-a67a-adede1d30dfd service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:07.846372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 741/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:09.986111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f8bf7-532c-4179-a25d-88b9397cb351 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:09.986661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f8bf7-532c-4179-a25d-88b9397cb351 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:09.986661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f8bf7-532c-4179-a25d-88b9397cb351 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:09.988013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 741/1482] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:09.993261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff083e-7610-4111-a8ed-d97df63cbaae None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:09.993731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff083e-7610-4111-a8ed-d97df63cbaae None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:09.993901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff083e-7610-4111-a8ed-d97df63cbaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:10.063229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-46ff083e-7610-4111-a8ed-d97df63cbaae None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:10.064937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46ff083e-7610-4111-a8ed-d97df63cbaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:10.115376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:10.172073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 742/1483] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:10.462336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f8bf7-532c-4179-a25d-88b9397cb351 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:10.463922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-096f8bf7-532c-4179-a25d-88b9397cb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:10.488714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:10.569723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f8bf7-532c-4179-a25d-88b9397cb351 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:10.643170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:10.643781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:10.644122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:10.644389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:10.646038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:10.720372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:10.756953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:10.758576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2aa2-aa2b-4373-b93f-f3547f8f7eeb service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:10.778511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 742/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:12.808750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8c09e-f36f-4e2d-9dd7-411caa05bd60 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:12.809388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8c09e-f36f-4e2d-9dd7-411caa05bd60 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:12.809388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8c09e-f36f-4e2d-9dd7-411caa05bd60 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:12.810773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 743/1485] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:12.816824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03db87-f04a-4ab8-ad2c-bef499e0ee55 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:12.817391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03db87-f04a-4ab8-ad2c-bef499e0ee55 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:12.817391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03db87-f04a-4ab8-ad2c-bef499e0ee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:12.891422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8e03db87-f04a-4ab8-ad2c-bef499e0ee55 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:12.893043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8e03db87-f04a-4ab8-ad2c-bef499e0ee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:12.990759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 743/1486] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:13.274196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8c09e-f36f-4e2d-9dd7-411caa05bd60 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:13.275724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fef8c09e-f36f-4e2d-9dd7-411caa05bd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:13.379590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8c09e-f36f-4e2d-9dd7-411caa05bd60 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:13.452863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:13.454823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:13.455474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:13.455982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:13.456308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:13.458388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:13.568944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:13.570425 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d228a5-0ce7-4d22-81b8-b75e2afcce9a service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:13.588701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 744/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:15.605923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5f60-4e32-4db1-a88f-89e7161ff4ca None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:15.606547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5f60-4e32-4db1-a88f-89e7161ff4ca None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:15.606547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb5f60-4e32-4db1-a88f-89e7161ff4ca None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:15.607737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 744/1488] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:36:15.613042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e894-a881-42f2-b22d-399b689d3cb1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:15.613518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e894-a881-42f2-b22d-399b689d3cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:15.613644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057e894-a881-42f2-b22d-399b689d3cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:15.681598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6057e894-a881-42f2-b22d-399b689d3cb1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:15.682831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6057e894-a881-42f2-b22d-399b689d3cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:15.735334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:15.782758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 745/1489] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:16.076192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5f60-4e32-4db1-a88f-89e7161ff4ca None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:16.077784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0ddb5f60-4e32-4db1-a88f-89e7161ff4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:16.114499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:16.184672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb5f60-4e32-4db1-a88f-89e7161ff4ca None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:16.260519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:16.261121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:16.261425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:16.261695 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:16.263310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:16.342682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:16.372785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:16.374269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7df4f-f0f6-42ab-8c26-9e9181362bc4 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:16.391985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 745/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:18.564983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8d0f8-69ea-4be1-ad60-effeff42860e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:18.565525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8d0f8-69ea-4be1-ad60-effeff42860e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:18.565620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8d0f8-69ea-4be1-ad60-effeff42860e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:18.566919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 746/1491] 10.222.0.67 () {54 vars in 927 bytes} [Mon Aug 29 23:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 29 23:36:18.572281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3059cba-6b77-4821-9950-20c3cacf6500 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:18.572726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3059cba-6b77-4821-9950-20c3cacf6500 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:18.572936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3059cba-6b77-4821-9950-20c3cacf6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:18.641066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c3059cba-6b77-4821-9950-20c3cacf6500 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:36:18.642935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c3059cba-6b77-4821-9950-20c3cacf6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:18.741066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 746/1492] 10.222.0.67 () {58 vars in 1024 bytes} [Mon Aug 29 23:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:36:19.037828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8d0f8-69ea-4be1-ad60-effeff42860e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:36:19.039416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f8c8d0f8-69ea-4be1-ad60-effeff42860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:19.259811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8d0f8-69ea-4be1-ad60-effeff42860e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:36:19.333791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:36:19.334395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:36:19.334727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:36:19.335048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:36:19.337016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:36:19.347404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:19.451525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:36:19.452974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b89f-4154-45f4-828c-5219546cce4b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:36:19.474898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 747/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:36:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:36:28.738993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=82 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:36:29.472100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=50 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.104826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.105466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.105466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.181963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:32.183158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:32.280533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 747/1494] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:37:32.288546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.289048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.289236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.364977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:32.366209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:32.463072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 748/1495] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:37:32.467763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.469040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:32.481186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba5818-2292-4c8c-9488-16779e4145c4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.541671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.575651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.576248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.576528 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.576790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.577464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:37:32.577761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.578768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:32.578768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:37:32.578768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:37:32.579637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:32.590782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 748/1496] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:37:32.599107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.608840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f34735-f632-42a0-a5fa-913be741fe42 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.670221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:32.707320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.707920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.708191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.708454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.709082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.711117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:32.711117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:37:32.711117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:37:32.712284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:32.769639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 749/1497] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:37:32 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:32.773891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:32.775425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:32.808316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca05ea-7c4a-4f7c-9f8e-eac30253fbe1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:32.906127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:32.906731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:32.907005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:32.907266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:32.907885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:32.908890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:32.908890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:37:32.908890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:37:32.910113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.070183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 749/1498] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:37:32 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:37:33.074311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.075840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.137492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94608b5-f8d7-46a8-9af1-c0e539e0748a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.224484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:33.236899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.237544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.237824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.238092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.238764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:33.239775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:33.239775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:37:33.239775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:37:33.240649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.253167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 750/1499] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:37:33.257178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.258723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.270533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21fd80-42d3-45fe-9442-2940e8bcedd3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.296200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:33.365475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.366079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.366354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.366622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.367259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:33.368280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:33.368280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:37:33.368280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:37:33.369159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5ede-00d4-48e5-bb33-357fb3cca387 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.381889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 750/1500] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:37:33.386146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.387649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.424896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6e4a7-3735-4754-8438-d5b27799591b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:33.523111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:33.523768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.524049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.524321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] PATH_INFO: `/v3/projects/f16cc73ce3b2436b8c1026ea2e0bedee/users/7fbd7b34e11d41c2af573908d7572da3/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.547038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f16cc73ce3b2436b8c1026ea2e0bedee, user_id=7fbd7b34e11d41c2af573908d7572da3, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:33.548069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:33.548069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:37:33.548069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:37:33.550095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026fe65-8aea-407e-8457-5633a4741fb2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:33.574140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 751/1501] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:37:33 2022] PUT /identity/v3/projects/f16cc73ce3b2436b8c1026ea2e0bedee/users/7fbd7b34e11d41c2af573908d7572da3/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:33.587061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ee347-1593-42fa-8dd4-ea35ffea0506 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.587351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ee347-1593-42fa-8dd4-ea35ffea0506 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.587625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ee347-1593-42fa-8dd4-ea35ffea0506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.643943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-867ee347-1593-42fa-8dd4-ea35ffea0506 None None] MFA Rules not processed for user `7fbd7b34e11d41c2af573908d7572da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:33.645056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-867ee347-1593-42fa-8dd4-ea35ffea0506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.723079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 751/1502] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:37:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:37:33.736176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11708-a773-4169-866a-a8e7b02e2cf4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.736466 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11708-a773-4169-866a-a8e7b02e2cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.736745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d11708-a773-4169-866a-a8e7b02e2cf4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.738126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 752/1503] 10.222.0.67 () {54 vars in 964 bytes} [Mon Aug 29 23:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:33.743034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96896223-e419-4dbf-a662-d20dfaba4d6c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:33.743318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96896223-e419-4dbf-a662-d20dfaba4d6c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:33.743585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96896223-e419-4dbf-a662-d20dfaba4d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:33.778014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:33.822822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-96896223-e419-4dbf-a662-d20dfaba4d6c None None] MFA Rules not processed for user `573e64b25ae04a47aa757ba787fc850e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:33.824040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-96896223-e419-4dbf-a662-d20dfaba4d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.901613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 752/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Mon Aug 29 23:37:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:37:33.909517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11708-a773-4169-866a-a8e7b02e2cf4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:33.911047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c3d11708-a773-4169-866a-a8e7b02e2cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:33.963067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.016843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d11708-a773-4169-866a-a8e7b02e2cf4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:34.089913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:34.090523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.090798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.091062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.092662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.192236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:34.193620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:34.197106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.212377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 753/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:37:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:37:34.256857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170039c-a6c9-488e-a481-60da74c8640d None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.257141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170039c-a6c9-488e-a481-60da74c8640d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.257443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170039c-a6c9-488e-a481-60da74c8640d None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.258744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 753/1506] 10.222.0.67 () {52 vars in 830 bytes} [Mon Aug 29 23:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:37:34.262287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:34.263503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.366585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49b2c58-0cb8-4830-accb-b7df418c912c service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:34.461104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:34.461805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.461952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.462223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] PATH_INFO: `/v3/users/7fbd7b34e11d41c2af573908d7572da3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.475559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbd7b34e11d41c2af573908d7572da3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:34.476589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:34.476589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:37:34.476589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:37:34.477841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:34.488296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.546530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbd7b34e11d41c2af573908d7572da3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:34.561005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbd7b34e11d41c2af573908d7572da3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:34.570222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbd7b34e11d41c2af573908d7572da3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:34.570669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbd7b34e11d41c2af573908d7572da3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:34.594356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbd7b34e11d41c2af573908d7572da3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:34.600069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 754/1507] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:37:34 2022] DELETE /identity/v3/users/7fbd7b34e11d41c2af573908d7572da3 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:37:34.604550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.604831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.605099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.661910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:37:34.663126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.739250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.752177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 754/1508] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:37:34.762060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:34.763419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:34.863699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a24e42-f61d-4a82-a9f4-11ca46083ab0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:34.919335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:34.940816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:34.941458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:34.941742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:34.942021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:34.943626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:35.052195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.053625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01174fd3-0e16-40fa-a077-a526b60acf30 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.072120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 755/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:37:35.430648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:37:35.431952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:37:35.443856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704ddb2-1041-4c33-aec7-e91b1fd7205e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:37:35.549042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:37:35.549706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:37:35.549983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:37:35.550250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] PATH_INFO: `/v3/projects/f16cc73ce3b2436b8c1026ea2e0bedee` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:37:35.560174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f16cc73ce3b2436b8c1026ea2e0bedee)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:37:35.561142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:37:35.561142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:37:35.561142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:37:35.563004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:37:35.621880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f16cc73ce3b2436b8c1026ea2e0bedee', 'request_id': 'req-aef864ab-830c-4bce-89ae-86dc59c56339'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:35.633418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f16cc73ce3b2436b8c1026ea2e0bedee', 'request_id': 'req-aef864ab-830c-4bce-89ae-86dc59c56339'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:35.640748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f16cc73ce3b2436b8c1026ea2e0bedee', 'request_id': 'req-aef864ab-830c-4bce-89ae-86dc59c56339'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:35.669535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] The token cache is being invalidate because project f16cc73ce3b2436b8c1026ea2e0bedee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:37:35.669818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:35.670238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aef864ab-830c-4bce-89ae-86dc59c56339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:37:35.672112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 755/1510] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:37:35 2022] DELETE /identity/v3/projects/f16cc73ce3b2436b8c1026ea2e0bedee => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:37:45.069874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=62 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:37:45.667505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:11.222943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3e7c2-8387-4434-8ce1-ac7b47106da4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.223541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3e7c2-8387-4434-8ce1-ac7b47106da4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.223541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3e7c2-8387-4434-8ce1-ac7b47106da4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.224850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:11.229719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b05848-d3fd-469e-a027-d836ca7b17ff None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.230184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b05848-d3fd-469e-a027-d836ca7b17ff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.230286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b05848-d3fd-469e-a027-d836ca7b17ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.312938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-02b05848-d3fd-469e-a027-d836ca7b17ff None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:11.314206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-02b05848-d3fd-469e-a027-d836ca7b17ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:11.416683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:11.574007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3e7c2-8387-4434-8ce1-ac7b47106da4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:11.576191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-28d3e7c2-8387-4434-8ce1-ac7b47106da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:11.695782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3e7c2-8387-4434-8ce1-ac7b47106da4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:11.702257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52bdd-75c2-4698-ac34-ebe9c0796a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:11.702742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52bdd-75c2-4698-ac34-ebe9c0796a2c service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:11.703030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52bdd-75c2-4698-ac34-ebe9c0796a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:11.703307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52bdd-75c2-4698-ac34-ebe9c0796a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:11.711815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52bdd-75c2-4698-ac34-ebe9c0796a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:11.713421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e52bdd-75c2-4698-ac34-ebe9c0796a2c service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:11.722946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 757/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:12.556518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3c02-9593-4a1b-9084-5f6741920360 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.557056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3c02-9593-4a1b-9084-5f6741920360 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.557056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb3c02-9593-4a1b-9084-5f6741920360 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.558397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:12.563169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96498-be31-44e3-bc65-c6e8a80be3ff None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.563640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96498-be31-44e3-bc65-c6e8a80be3ff None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.563739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c96498-be31-44e3-bc65-c6e8a80be3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.584194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-23c96498-be31-44e3-bc65-c6e8a80be3ff None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:12.585721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-23c96498-be31-44e3-bc65-c6e8a80be3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:12.594220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:12.746643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb3c02-9593-4a1b-9084-5f6741920360 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:12.761985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb3c02-9593-4a1b-9084-5f6741920360 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:12.769250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf55e1-5fe7-459b-9d53-8fe3e20cba8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:12.770645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf55e1-5fe7-459b-9d53-8fe3e20cba8f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:12.771085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf55e1-5fe7-459b-9d53-8fe3e20cba8f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:12.771420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf55e1-5fe7-459b-9d53-8fe3e20cba8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:12.780424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf55e1-5fe7-459b-9d53-8fe3e20cba8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:12.782124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf55e1-5fe7-459b-9d53-8fe3e20cba8f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:12.791861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 758/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:13.244315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904331-d79a-47ed-9c7c-1e80b925c8eb None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.244632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904331-d79a-47ed-9c7c-1e80b925c8eb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.244904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07904331-d79a-47ed-9c7c-1e80b925c8eb None None] PATH_INFO: `/v3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.246865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 759/1517] 10.222.0.94 () {54 vars in 925 bytes} [Mon Aug 29 23:39:13 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:39:13.253831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8053cf-91eb-4dd6-87b3-6eddb43c80af None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:13.254140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8053cf-91eb-4dd6-87b3-6eddb43c80af None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:13.254410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8053cf-91eb-4dd6-87b3-6eddb43c80af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:13.315416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0b8053cf-91eb-4dd6-87b3-6eddb43c80af None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:13.316631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0b8053cf-91eb-4dd6-87b3-6eddb43c80af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:13.333796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:13.390498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 759/1518] 10.222.0.94 () {58 vars in 1015 bytes} [Mon Aug 29 23:39:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:17.300630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1296-acb3-4147-b222-476e33f7dab1 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.301153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1296-acb3-4147-b222-476e33f7dab1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.301153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1296-acb3-4147-b222-476e33f7dab1 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.302447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 760/1519] 10.222.0.67 () {54 vars in 961 bytes} [Mon Aug 29 23:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:17.308087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90c7b-1758-436c-802e-3cb7cc3fd8d6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.308537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90c7b-1758-436c-802e-3cb7cc3fd8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.308636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd90c7b-1758-436c-802e-3cb7cc3fd8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.328989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7fd90c7b-1758-436c-802e-3cb7cc3fd8d6 None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:17.330224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7fd90c7b-1758-436c-802e-3cb7cc3fd8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:17.339280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 760/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Mon Aug 29 23:39:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:17.346911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded1296-acb3-4147-b222-476e33f7dab1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:17.360498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded1296-acb3-4147-b222-476e33f7dab1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:17.365871 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b88d9f-8f77-489a-a0f5-99feb9b7adaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:17.366567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b88d9f-8f77-489a-a0f5-99feb9b7adaa service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:17.366850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b88d9f-8f77-489a-a0f5-99feb9b7adaa service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:17.367128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b88d9f-8f77-489a-a0f5-99feb9b7adaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:17.376743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b88d9f-8f77-489a-a0f5-99feb9b7adaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:17.378405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b88d9f-8f77-489a-a0f5-99feb9b7adaa service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:17.388780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 761/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:24.030593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8a595-f3da-427e-ab2a-7711d1ebf57b None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.031226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8a595-f3da-427e-ab2a-7711d1ebf57b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.031226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8a595-f3da-427e-ab2a-7711d1ebf57b None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.032483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:24.037237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a637d5-e357-4e01-9ec7-6e65dd2723a3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.037762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a637d5-e357-4e01-9ec7-6e65dd2723a3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.037867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a637d5-e357-4e01-9ec7-6e65dd2723a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.058484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-77a637d5-e357-4e01-9ec7-6e65dd2723a3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:24.059684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-77a637d5-e357-4e01-9ec7-6e65dd2723a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:24.067517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:24.225793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8a595-f3da-427e-ab2a-7711d1ebf57b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:24.240917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8a595-f3da-427e-ab2a-7711d1ebf57b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:24.246379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b69e7-71bb-4e5e-b68c-c3bb364d9d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:24.246971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b69e7-71bb-4e5e-b68c-c3bb364d9d6e service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:24.247279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b69e7-71bb-4e5e-b68c-c3bb364d9d6e service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:24.247548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b69e7-71bb-4e5e-b68c-c3bb364d9d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:24.255983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b69e7-71bb-4e5e-b68c-c3bb364d9d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:24.257623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b69e7-71bb-4e5e-b68c-c3bb364d9d6e service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:24.267443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 762/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:25.098468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f0a9-66aa-473f-b366-fa6c81455ea4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.099004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f0a9-66aa-473f-b366-fa6c81455ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.099004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93f0a9-66aa-473f-b366-fa6c81455ea4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.100306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 29 23:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:25.105982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed85b-015f-4fb0-b7b9-c00a33e98488 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.106515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed85b-015f-4fb0-b7b9-c00a33e98488 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.106515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ed85b-015f-4fb0-b7b9-c00a33e98488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.126730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-588ed85b-015f-4fb0-b7b9-c00a33e98488 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:25.127961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-588ed85b-015f-4fb0-b7b9-c00a33e98488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:25.136958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 29 23:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:25.292271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f0a9-66aa-473f-b366-fa6c81455ea4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:25.308462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93f0a9-66aa-473f-b366-fa6c81455ea4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:25.313880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee3bb-83d8-42b8-9318-7cd127c67f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:25.314474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee3bb-83d8-42b8-9318-7cd127c67f66 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:25.314746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee3bb-83d8-42b8-9318-7cd127c67f66 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:25.315011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee3bb-83d8-42b8-9318-7cd127c67f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:25.323380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee3bb-83d8-42b8-9318-7cd127c67f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:25.324957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee3bb-83d8-42b8-9318-7cd127c67f66 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:25.334239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 764/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:29.245884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5dd5-1dda-40ae-931b-ccad663561d7 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.246444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5dd5-1dda-40ae-931b-ccad663561d7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.246444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5dd5-1dda-40ae-931b-ccad663561d7 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.247790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:29.252858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effff94-1bd1-48d1-991e-97d2a533e6a6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.253319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effff94-1bd1-48d1-991e-97d2a533e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.253468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effff94-1bd1-48d1-991e-97d2a533e6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.273267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7effff94-1bd1-48d1-991e-97d2a533e6a6 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:29.274521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7effff94-1bd1-48d1-991e-97d2a533e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:29.282479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:39:29.580287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5dd5-1dda-40ae-931b-ccad663561d7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:29.582042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-29bb5dd5-1dda-40ae-931b-ccad663561d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:29.660493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5dd5-1dda-40ae-931b-ccad663561d7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:29.664038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f460d-6ee3-4ad4-a705-f7db172b26fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:29.664667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f460d-6ee3-4ad4-a705-f7db172b26fd service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:29.664954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f460d-6ee3-4ad4-a705-f7db172b26fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:29.665228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f460d-6ee3-4ad4-a705-f7db172b26fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:29.674753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f460d-6ee3-4ad4-a705-f7db172b26fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:29.676184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f460d-6ee3-4ad4-a705-f7db172b26fd service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:29.686072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 765/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:31.599743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a20f2-b7f1-4dd8-b3af-79a6ae8888bd None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:31.600322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a20f2-b7f1-4dd8-b3af-79a6ae8888bd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:31.600322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a20f2-b7f1-4dd8-b3af-79a6ae8888bd None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:31.601941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:31.607791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb241b-139e-46c4-9152-3756af196ee6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:31.608282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb241b-139e-46c4-9152-3756af196ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:31.608388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb241b-139e-46c4-9152-3756af196ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:31.632261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-03eb241b-139e-46c4-9152-3756af196ee6 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:31.633499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-03eb241b-139e-46c4-9152-3756af196ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:31.641310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:31.930353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a20f2-b7f1-4dd8-b3af-79a6ae8888bd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:31.941220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a20f2-b7f1-4dd8-b3af-79a6ae8888bd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:31.945463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd214e15-4e5e-4b80-aea7-0831e0cb81d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:31.946054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214e15-4e5e-4b80-aea7-0831e0cb81d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:31.946347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214e15-4e5e-4b80-aea7-0831e0cb81d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:31.946596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd214e15-4e5e-4b80-aea7-0831e0cb81d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:31.958108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd214e15-4e5e-4b80-aea7-0831e0cb81d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:31.959531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd214e15-4e5e-4b80-aea7-0831e0cb81d9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:31.969852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 767/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:35.698963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de427-7ee6-486c-9c53-83c02a328f98 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:35.699557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de427-7ee6-486c-9c53-83c02a328f98 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:35.699557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de427-7ee6-486c-9c53-83c02a328f98 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:35.700976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:35.706057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f498f50-1347-4828-8cb9-ca0c5e2b3d26 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:35.706589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f498f50-1347-4828-8cb9-ca0c5e2b3d26 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:35.706589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f498f50-1347-4828-8cb9-ca0c5e2b3d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:35.715151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:35.732817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8f498f50-1347-4828-8cb9-ca0c5e2b3d26 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:35.734067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f498f50-1347-4828-8cb9-ca0c5e2b3d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:35.742193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:39:36.301478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de427-7ee6-486c-9c53-83c02a328f98 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:36.303190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-539de427-7ee6-486c-9c53-83c02a328f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:36.368711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:36.383781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de427-7ee6-486c-9c53-83c02a328f98 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:36.387477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54410dc6-4cda-4ab4-b13a-77085c0d45e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:36.388103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410dc6-4cda-4ab4-b13a-77085c0d45e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:36.388403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410dc6-4cda-4ab4-b13a-77085c0d45e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:36.388696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54410dc6-4cda-4ab4-b13a-77085c0d45e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:36.397740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54410dc6-4cda-4ab4-b13a-77085c0d45e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:36.399249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54410dc6-4cda-4ab4-b13a-77085c0d45e4 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:36.408710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 768/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:38.349243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bb32b-2f8b-45ae-a604-694100ead051 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:38.349840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bb32b-2f8b-45ae-a604-694100ead051 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:38.349840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778bb32b-2f8b-45ae-a604-694100ead051 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:38.351136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 29 23:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:39:38.356522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc156a4-767d-4ce0-a574-a64e5e476a60 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:38.356987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc156a4-767d-4ce0-a574-a64e5e476a60 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:38.357097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc156a4-767d-4ce0-a574-a64e5e476a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:38.376826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6fc156a4-767d-4ce0-a574-a64e5e476a60 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:39:38.378066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fc156a4-767d-4ce0-a574-a64e5e476a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:38.387374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 29 23:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:39:38.966253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bb32b-2f8b-45ae-a604-694100ead051 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:39:38.968045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-778bb32b-2f8b-45ae-a604-694100ead051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:39:38.982253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778bb32b-2f8b-45ae-a604-694100ead051 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:39:38.986053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f40587-30e0-4530-8439-5c19e4bf54b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:39:38.986668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40587-30e0-4530-8439-5c19e4bf54b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:39:38.986951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40587-30e0-4530-8439-5c19e4bf54b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:39:38.987221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f40587-30e0-4530-8439-5c19e4bf54b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:39:38.996932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f40587-30e0-4530-8439-5c19e4bf54b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:39:38.998385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f40587-30e0-4530-8439-5c19e4bf54b0 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:39:39.008113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 770/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:39:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:39:48.371867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=11 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:39:49.003653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:11.045570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615abe7-ce96-4829-9a0b-e34c6aa20a2b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.046722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615abe7-ce96-4829-9a0b-e34c6aa20a2b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.047231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615abe7-ce96-4829-9a0b-e34c6aa20a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.071286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8615abe7-ce96-4829-9a0b-e34c6aa20a2b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.072441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8615abe7-ce96-4829-9a0b-e34c6aa20a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.085960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 770/1540] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.089903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1e0f4-35cd-4ced-a0cd-dbcfe6378070 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.090860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1e0f4-35cd-4ced-a0cd-dbcfe6378070 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.091358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1e0f4-35cd-4ced-a0cd-dbcfe6378070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.095050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f777-0baa-4ea3-ac0b-4257a76c1f40 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.095335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f777-0baa-4ea3-ac0b-4257a76c1f40 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.095607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8f777-0baa-4ea3-ac0b-4257a76c1f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.129379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-80d1e0f4-35cd-4ced-a0cd-dbcfe6378070 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.130399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-29c8f777-0baa-4ea3-ac0b-4257a76c1f40 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.132222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-80d1e0f4-35cd-4ced-a0cd-dbcfe6378070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.132471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-29c8f777-0baa-4ea3-ac0b-4257a76c1f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.148061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 771/1541] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:11.149925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791dc9e-6526-4932-b2fb-3922261832ab None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.150438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791dc9e-6526-4932-b2fb-3922261832ab None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.151118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791dc9e-6526-4932-b2fb-3922261832ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.156731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 771/1542] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:11.156731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b08ab-e786-4524-8bee-69853c6bc0c9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.156993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b08ab-e786-4524-8bee-69853c6bc0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.157093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b08ab-e786-4524-8bee-69853c6bc0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.182154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-114b08ab-e786-4524-8bee-69853c6bc0c9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.183475 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-114b08ab-e786-4524-8bee-69853c6bc0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.184218 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2791dc9e-6526-4932-b2fb-3922261832ab None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.186475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2791dc9e-6526-4932-b2fb-3922261832ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.197708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 772/1543] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.198292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 772/1544] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.198985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bd1e-7dbf-4593-b3cd-956e74790162 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.199275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bd1e-7dbf-4593-b3cd-956e74790162 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.199791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2bd1e-7dbf-4593-b3cd-956e74790162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.201397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.205866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.206147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.226486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.227712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.227953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9fd2bd1e-7dbf-4593-b3cd-956e74790162 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.229444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9fd2bd1e-7dbf-4593-b3cd-956e74790162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.236230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 773/1545] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.237081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.238619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 773/1546] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.241026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484062b-6237-4694-aca5-b4ca5763aacb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.241523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484062b-6237-4694-aca5-b4ca5763aacb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.242001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484062b-6237-4694-aca5-b4ca5763aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.247995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61a3b1-206e-482b-ab58-b507d08f5b0a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.253229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.253861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.254140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.254411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.255054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.255353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.257623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d823e-a7da-42c9-ac2f-31429be2f6d0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.262955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0484062b-6237-4694-aca5-b4ca5763aacb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.264139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0484062b-6237-4694-aca5-b4ca5763aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.270198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 774/1547] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.271271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa554e-8a03-4318-ae0c-777672d8420d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.271558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa554e-8a03-4318-ae0c-777672d8420d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.271830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa554e-8a03-4318-ae0c-777672d8420d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.272012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 774/1548] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.273195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09cec-f58c-44d2-a5df-ed1f1c50f732 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.277100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09cec-f58c-44d2-a5df-ed1f1c50f732 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.277100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c09cec-f58c-44d2-a5df-ed1f1c50f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.294818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-35c09cec-f58c-44d2-a5df-ed1f1c50f732 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.295039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c0aa554e-8a03-4318-ae0c-777672d8420d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.296184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c0aa554e-8a03-4318-ae0c-777672d8420d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.296587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-35c09cec-f58c-44d2-a5df-ed1f1c50f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.304679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 775/1549] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.305085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 775/1550] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.306298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665e815-3eed-4e8e-b741-3f77fc00ca7f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.306577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665e815-3eed-4e8e-b741-3f77fc00ca7f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.306845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8665e815-3eed-4e8e-b741-3f77fc00ca7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.309643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92db9-b7a6-4fd9-9cbb-13ddf512fa6c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.309919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92db9-b7a6-4fd9-9cbb-13ddf512fa6c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.310219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a92db9-b7a6-4fd9-9cbb-13ddf512fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.329998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8665e815-3eed-4e8e-b741-3f77fc00ca7f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.330387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-84a92db9-b7a6-4fd9-9cbb-13ddf512fa6c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.331101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8665e815-3eed-4e8e-b741-3f77fc00ca7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.331562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-84a92db9-b7a6-4fd9-9cbb-13ddf512fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.339357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 776/1551] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.339861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 776/1552] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.341152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.341467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.341739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.346019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.346381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.346801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.361333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.362564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.367279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.368483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.373317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 777/1553] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.373317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.377532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 777/1554] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.378376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.382402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28710478-8ff1-440f-a799-b1979b134d6f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.387063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.387660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.387939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.388210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.388547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a45f7c-f53f-4332-a98e-871b1bad1111 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.388851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.389151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.390786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.393854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.394453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.394745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.395018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.395651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.398212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.402603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 778/1555] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.403397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.413864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85a46d-8485-4461-91c5-1a29fe1b485e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.418416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.419002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.419276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.419549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.420177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.420587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.422319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dca7b5-886a-4bc4-989d-0435abc513a3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.434961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 779/1556] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.436259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0909930-024b-4570-b62b-523b31d438fe None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.436556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0909930-024b-4570-b62b-523b31d438fe None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.436824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0909930-024b-4570-b62b-523b31d438fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.438219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 778/1557] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.438908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.458268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b0909930-024b-4570-b62b-523b31d438fe None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.459769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b0909930-024b-4570-b62b-523b31d438fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.502345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9293cc-f7be-4fd4-bb7c-7d6625c85429 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.507821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.508428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.508729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.509001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.509674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.509976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.510995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:41:11.510995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:41:11.510995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:41:11.512157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.521112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 780/1558] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.522618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.523020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.523398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.525790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 779/1559] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.526823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.544816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfba67-1bb5-4d9b-adc6-7de55741e64e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.549437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.550028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:11.550165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.550310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.550586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.551281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:11.551575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.552120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.553982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.559996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 781/1560] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:11.562763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.569372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 780/1561] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.570032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.577782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3decd6-273a-4f90-8829-04c18b230a33 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.581587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8796e6b-5ee4-4571-b523-f3ebfb4d154c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.582546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.583269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.583455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.584117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.585023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.585323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.586502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.586979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.587087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.587360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.587629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.588290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.590279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.599744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 782/1562] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.600549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.610312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb97e95-faa5-403d-a3f1-a1309d9f60b0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.616363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.617168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.617624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.617976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.618683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.620687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.625052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 781/1563] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.625972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.646005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 783/1564] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.646005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.654579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99600e77-736f-424b-a89b-f9bb69dca67d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.673716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:11.691531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:11.693624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856ff5f-4f0e-488e-be55-bed01ad3d5e9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.698382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.699055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.699335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.699610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.700244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.702198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.716520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.717129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.717451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.717722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.718363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.718668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.720314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.730314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 782/1565] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.731208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.740933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 784/1566] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.740933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.745922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4a129-a5cb-4c1c-bdec-6f20f412a963 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.793909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d9def-7617-41f2-816c-5ea792ced303 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.798601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.799206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.799486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.799757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.800392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.802958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.803208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.803810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.804084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.804348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.805010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:11.805371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.807060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.819556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 785/1567] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:11.820492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.830459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555f64-711f-4b28-9010-67da5d3aa6d5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.835969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:41:11.840792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:41:11.841940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.845954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 783/1568] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.847848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.877254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 786/1569] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.878135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.915193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae882121-e6b0-4b8c-9a35-0cc14ffc4e29 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.941995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f8516-9c2d-4105-a7fa-2222eca48ba3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.947562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.948170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.948439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.948719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.949366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.951365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.972871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 787/1570] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:11.972871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:11.976219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.976219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.976219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.976219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.976588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.978472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:11.983109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:11.983542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547b0fa-94b0-4cea-a4c3-aff2e3319cec admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:11.989048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:11.989681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:11.990445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:11.990933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:11.991553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:11.993174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.004160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 788/1571] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.005078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.009193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 784/1572] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:11 2022] POST /identity/v3/projects => generated 389 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.010056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.016225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064939-7fcf-493c-beb6-a513127e03f5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.035580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:12.070583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f81f46-3072-4061-89d1-3beb34d46a28 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.075144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.075749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.075972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.076460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.076460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.076644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.076899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.077033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.077174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.077813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.078837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.079872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.107246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 789/1573] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.107246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.110038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 785/1574] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.110845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.120322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a59123-52f1-478e-bdaf-8207198dd681 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.174094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ceaef1-18cf-490b-8fc3-11082875a134 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.178265 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.178895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.179176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.179341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.179457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.179884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.180070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.180170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.180424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.181051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.182014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.182227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:41:12.182227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:41:12.182227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:41:12.183439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.210074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 786/1575] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.210074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.211346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 790/1576] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.212023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.218719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007bf18-fd2a-4061-90e1-7ac752db7c7b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.276562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03a1a8-b134-40fa-8b25-b89710606e59 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.278551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.279165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.279442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.279707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.280386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.281451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.282121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.282502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.282665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.283765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.284488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.286066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.293208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:12.298286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 791/1577] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.298962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.312967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82af29e-d7ba-43b5-ad32-dd1e54b37f9b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.316861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 787/1578] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.320236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.321995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.322634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.322906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.323177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.323853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.325552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.329366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd84f6-b681-448a-ac3c-177a4822b9e0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.335121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.335745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.336024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.336295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.339562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 792/1579] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.339706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.339799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.339891 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.347418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0e09-52a5-4a3b-84f3-0ec63fa977bd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.352733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.353405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.353692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.353987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.354713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.356508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.365493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 788/1580] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/users => generated 295 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.366536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.368508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 793/1581] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.369453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.376318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42bd5b-692a-4a12-9ae9-222283f70646 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.379180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b9fe3-f3d0-4245-9a39-59840076016f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.380892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.381605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.381884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.382153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.382781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.383997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.384591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.384734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.384878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.385148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.385825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.387421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.393706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:12.402277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 794/1582] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.402277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.409383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 789/1583] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.409383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.415460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e04678-20cc-4b07-905a-f2717e0fc349 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.419938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36402b83-abc3-4f10-9295-8ee95ae1b0ee admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.420251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.420828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.421103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.421549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.422027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.423939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.424632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.425211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.425522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.425787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.426417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.428589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.439275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 790/1584] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.440414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.450090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 795/1585] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/users => generated 278 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:12.450090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.451356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca290972-6e57-4007-90de-68d421e53616 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.455850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.456442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.456715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.456986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.457663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.457937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d2ed2-1f82-498a-827b-25fe0d325c15 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.459659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.462827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.463470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.463754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.464035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] PATH_INFO: `/v3/projects/cd9a3aae514e4fe9aa76e37ea18a13b6/users/d94d22c104a84a20b764557b2e4a94de/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.469758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 791/1586] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.470553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.481208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f2424-e560-40d6-a149-c9b37044ccd1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.481439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9a3aae514e4fe9aa76e37ea18a13b6, user_id=d94d22c104a84a20b764557b2e4a94de, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.482550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:41:12.482550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:41:12.482550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:41:12.484582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.485720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.486300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.486586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.486853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.487517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.489090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.498239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 796/1587] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:12 2022] PUT /identity/v3/projects/cd9a3aae514e4fe9aa76e37ea18a13b6/users/d94d22c104a84a20b764557b2e4a94de/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:12.499043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.502245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 792/1588] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.503818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.514734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73413027-a07b-45a1-8493-c6b6da37b128 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.562972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf857a7-6d88-462a-a32c-a14d72f4e922 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.567978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.568613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.568891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.569162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.569837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.571517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.572955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.573589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.573867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.574137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.574777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.576440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.581886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 797/1589] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.582749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.589720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 793/1590] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.589720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.595086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f57537-addb-4dc1-9b8a-ccd8a53b26c8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.597887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8095966-5e2e-466f-8641-ade26d8750c8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.601658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.602302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.602571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.602841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.603488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.605094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.605220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.605854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.606140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.606407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] PATH_INFO: `/v3/projects/abae41ba16dc487a83c19cc4cc5f95d3/users/d90000dd2b094facafada1ada1c8573f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.617927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 798/1591] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.621878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.625110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abae41ba16dc487a83c19cc4cc5f95d3, user_id=d90000dd2b094facafada1ada1c8573f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.627820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.631746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e941503-9552-4ce6-acbf-d5c8724073ab admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.637519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbf54d-fc98-4c02-8da5-cd84753da840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.638119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf54d-fc98-4c02-8da5-cd84753da840 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.638415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf54d-fc98-4c02-8da5-cd84753da840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.638697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbf54d-fc98-4c02-8da5-cd84753da840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.639339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf54d-fc98-4c02-8da5-cd84753da840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.641062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbf54d-fc98-4c02-8da5-cd84753da840 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.641920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 794/1592] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:12 2022] PUT /identity/v3/projects/abae41ba16dc487a83c19cc4cc5f95d3/users/d90000dd2b094facafada1ada1c8573f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:12.642731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.658863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 799/1593] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.658863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.658863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.658863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.680022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:12.681243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:12.699286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:12.713296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d2bd5-7fc2-4893-ab63-46f1c285e022 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.719281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.719893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.720168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.720435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.721226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.722856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.734313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 795/1594] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.735144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.745617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc484e-1b00-4947-8d3c-d3f3e927039e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.749849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 800/1595] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:12.750690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.757412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.758047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.758388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.758666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.759419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.761016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25244df3-77a6-4c8a-a5ed-40117c2740ff None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.761156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.767024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.767730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.768011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.768291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] PATH_INFO: `/v3/projects/df0bf1b0c20c47f982c07085aecc50a3/users/5a17f87b54ad4bdbb037f32e237b3925/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.773062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 796/1596] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.773952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.783665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ba61e9-8f0b-462b-a277-eda4bdcc9393 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.784451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0bf1b0c20c47f982c07085aecc50a3, user_id=5a17f87b54ad4bdbb037f32e237b3925, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.787837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.788786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e57a6-b846-4d4b-8d18-978ecd739891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.789455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e57a6-b846-4d4b-8d18-978ecd739891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.789733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e57a6-b846-4d4b-8d18-978ecd739891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.790006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e57a6-b846-4d4b-8d18-978ecd739891 admin admin] PATH_INFO: `/v3/projects/bfa215968d104866b553cd15ccfc8e12/users/77f0f626092648b9a700d9778c8ac453/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.801678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 801/1597] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:12 2022] PUT /identity/v3/projects/df0bf1b0c20c47f982c07085aecc50a3/users/5a17f87b54ad4bdbb037f32e237b3925/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:12.802659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.813786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:12.817730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e57a6-b846-4d4b-8d18-978ecd739891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa215968d104866b553cd15ccfc8e12, user_id=77f0f626092648b9a700d9778c8ac453, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.821096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e57a6-b846-4d4b-8d18-978ecd739891 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.837080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 797/1598] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:12 2022] PUT /identity/v3/projects/bfa215968d104866b553cd15ccfc8e12/users/77f0f626092648b9a700d9778c8ac453/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:12.838555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.838826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.839093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.869089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:12.873221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:12.877784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3419b3-5c24-47b9-b281-8d2969678010 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.937291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 798/1599] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:12.937291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.943094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.943094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.943094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.943094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.943464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.945183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.953668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76503269-5a29-49a0-a87f-bafb98b80222 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.960157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 802/1600] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.960157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.960911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.962122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.962692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.963248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.964572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.967494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:12.968191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc8212-b5fd-4c50-94b4-062afd98c4e8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:12.973802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:12.974516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:12.974796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:12.975073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] PATH_INFO: `/v3/projects/52f5111c66c540b0bfc9fb383621e1b9/users/7b153ae4d44c452689451adf19c680b8/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:12.978843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 799/1601] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:12.979287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:12.993908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f5111c66c540b0bfc9fb383621e1b9, user_id=7b153ae4d44c452689451adf19c680b8, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:12.996614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.012416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 803/1602] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:12 2022] PUT /identity/v3/projects/52f5111c66c540b0bfc9fb383621e1b9/users/7b153ae4d44c452689451adf19c680b8/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:13.013259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:13.037415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4f78e-426b-4b0e-ae14-307afbaf5494 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:13.079857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f7199-8d62-4e91-b5c6-359a6bd630f7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:13.085124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e921c-4c4f-4f7f-abb8-a6dc2c6fed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:13.085901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e921c-4c4f-4f7f-abb8-a6dc2c6fed51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.086181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e921c-4c4f-4f7f-abb8-a6dc2c6fed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.086454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e921c-4c4f-4f7f-abb8-a6dc2c6fed51 admin admin] PATH_INFO: `/v3/projects/1e0d3956303641d68d68dc5ae4f4cf17/users/06a40ad8ffc847028888ecda6221fcf4/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.094284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7143ee7-1d31-4081-aa9c-4ab47835816d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:13.094904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143ee7-1d31-4081-aa9c-4ab47835816d service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.095186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143ee7-1d31-4081-aa9c-4ab47835816d service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.095459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7143ee7-1d31-4081-aa9c-4ab47835816d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.103532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e921c-4c4f-4f7f-abb8-a6dc2c6fed51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0d3956303641d68d68dc5ae4f4cf17, user_id=06a40ad8ffc847028888ecda6221fcf4, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:13.105587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7143ee7-1d31-4081-aa9c-4ab47835816d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:13.106394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e921c-4c4f-4f7f-abb8-a6dc2c6fed51 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.107193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7143ee7-1d31-4081-aa9c-4ab47835816d service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.117633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 800/1603] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:13.118874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.119099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.119367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.120782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 804/1604] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:13 2022] PUT /identity/v3/projects/1e0d3956303641d68d68dc5ae4f4cf17/users/06a40ad8ffc847028888ecda6221fcf4/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:13.121854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.122124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.122393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.129206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:13.146324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:13.157491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] MFA Rules not processed for user `5a17f87b54ad4bdbb037f32e237b3925`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:13.158751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:13.161489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] MFA Rules not processed for user `77f0f626092648b9a700d9778c8ac453`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:13.163962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:13.237677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 801/1605] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:13.238544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:13.257532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 805/1606] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:13.258260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:13.330912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d5c7c-5779-410c-bea8-15d522cdf95b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:13.339395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21d6e6-b419-42cd-931c-7acb0b6802d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:13.340236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d6e6-b419-42cd-931c-7acb0b6802d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.340645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d6e6-b419-42cd-931c-7acb0b6802d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.341073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21d6e6-b419-42cd-931c-7acb0b6802d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.360094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67d1e7-3ff3-4417-a479-cc80599e33ce None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:13.365834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:13.366504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.366837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.367157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] PATH_INFO: `/v3/projects/4ca321651eb44dbcbc87b1fc5359ca2d/users/d3cbb2ac21b14840ad170624c9286834/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.386844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca321651eb44dbcbc87b1fc5359ca2d, user_id=d3cbb2ac21b14840ad170624c9286834, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:13.389784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.407185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 806/1607] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:13 2022] PUT /identity/v3/projects/4ca321651eb44dbcbc87b1fc5359ca2d/users/d3cbb2ac21b14840ad170624c9286834/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:13.408179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:13.422627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d6e6-b419-42cd-931c-7acb0b6802d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:13.424532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21d6e6-b419-42cd-931c-7acb0b6802d9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.435831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 802/1608] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:13.437270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.437835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.438050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.462997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:13.464319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:13.487461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2485f-6a38-4aa1-a597-f7c2f6812f75 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:13.503959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ead605-9419-41bb-859e-b3462e801d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:13.507468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead605-9419-41bb-859e-b3462e801d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.508022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead605-9419-41bb-859e-b3462e801d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.508467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ead605-9419-41bb-859e-b3462e801d20 admin admin] PATH_INFO: `/v3/projects/38d7e73281d34144be9656bad043477f/users/4d53aef7ffb74ebcb429ea0c4408d94a/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.527797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead605-9419-41bb-859e-b3462e801d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d7e73281d34144be9656bad043477f, user_id=4d53aef7ffb74ebcb429ea0c4408d94a, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:13.530584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ead605-9419-41bb-859e-b3462e801d20 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.539442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:13.548187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 807/1609] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:13 2022] PUT /identity/v3/projects/38d7e73281d34144be9656bad043477f/users/4d53aef7ffb74ebcb429ea0c4408d94a/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:13.553704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1f48d-1b9b-46b6-815e-1e438e1018c0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.553704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1f48d-1b9b-46b6-815e-1e438e1018c0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.553704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1f48d-1b9b-46b6-815e-1e438e1018c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.574414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:13.579120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 803/1610] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:13.580158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:13.584106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-46e1f48d-1b9b-46b6-815e-1e438e1018c0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:13.587116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-46e1f48d-1b9b-46b6-815e-1e438e1018c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:13.662293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4399c96-f48a-46f1-b96d-6f3409419a16 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:13.683682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 808/1611] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:13.685744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3afc-ffa8-428b-aaa6-a19e9c571f54 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.686279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3afc-ffa8-428b-aaa6-a19e9c571f54 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.686698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b3afc-ffa8-428b-aaa6-a19e9c571f54 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.688905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 809/1612] 10.222.0.67 () {54 vars in 962 bytes} [Mon Aug 29 23:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:13.690412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1686d-a0cf-49a2-8d7b-35e4661faa79 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.691002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1686d-a0cf-49a2-8d7b-35e4661faa79 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.691357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1686d-a0cf-49a2-8d7b-35e4661faa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.729457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8cd1686d-a0cf-49a2-8d7b-35e4661faa79 None None] MFA Rules not processed for user `d3cbb2ac21b14840ad170624c9286834`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:13.730995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8cd1686d-a0cf-49a2-8d7b-35e4661faa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:13.745154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:13.746268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.746925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.747862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.835844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 810/1613] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:13.841964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:13.842879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:13.842879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:13.867538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:13.870045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:13.886640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] MFA Rules not processed for user `4d53aef7ffb74ebcb429ea0c4408d94a`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:13.887958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:13.888447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 804/1614] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:13.889298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.004126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 811/1615] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:14.004126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.024458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5128ca-2f07-4bf4-918c-2b1c70aa8222 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.037564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01fd2f-1518-4357-b0b8-29169c1a611b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.038209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01fd2f-1518-4357-b0b8-29169c1a611b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.038491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01fd2f-1518-4357-b0b8-29169c1a611b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.038760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01fd2f-1518-4357-b0b8-29169c1a611b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.042309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e2b67-65cc-440f-b8b4-8d93a42ab7e2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.052065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:14.054293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.055200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.055634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.057905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01fd2f-1518-4357-b0b8-29169c1a611b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.058330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.061053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01fd2f-1518-4357-b0b8-29169c1a611b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.084609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 805/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:14.085154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.085937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.086221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.086493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.086703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.112243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 812/1617] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:14.113422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.139088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840af5d4-6fbc-4596-a0c4-581fc3fe57c9 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.160966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.161833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.162236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.162607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.163346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.166255 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.198984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:14.206700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:14.214876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:14.256261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 813/1618] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:14 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:14.257413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.348325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f108719-18cf-4f2d-b241-df3e1a0efc39 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.354568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.355194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.355478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.355748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.356398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.359092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.410245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 806/1619] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Aug 29 23:41:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:14.411384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.426942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 814/1620] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:14 2022] POST /identity/v3/projects => generated 355 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:14.427774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.446936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b9240-5f7d-456c-9cf1-3b79817cac64 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.573166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52728c-f81d-48c9-a32f-8f7c5b4c5404 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.588243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.589026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.589315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.589610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.627925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.629028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.629273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.629641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.631074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.634984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.714085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.714484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 807/1621] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:14 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:14.714578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.714674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.736125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 815/1622] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:14.737017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.753243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d3caf-1bb2-4b65-83fe-6904c5618700 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.762758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79c960-be56-4942-a04b-a7ac804def3a service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.769544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.771665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.772033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.772660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.772998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.773266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.773410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.773942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.774445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.777014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.777851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.783618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.801719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 816/1623] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:14.806426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.823579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:14.838733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde12d2-c1b4-4cd4-aba7-e690f571f61d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.843045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 808/1624] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:14 2022] POST /identity/v3/users => generated 284 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:14.844538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.858728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.859532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.859672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.859940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] PATH_INFO: `/v3/projects/735a2b40252b44d3b6c136d2d263c9a3/users/a49c84ba4b27431f827bdc9aa8a81f9f/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.866935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c8b89-a862-472a-9d8c-2e6d2fabe607 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:14.882182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:14.883555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:14.883934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:14.884213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:14.885537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.889603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.898362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=735a2b40252b44d3b6c136d2d263c9a3, user_id=a49c84ba4b27431f827bdc9aa8a81f9f, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:14.901146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:14.928682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 809/1625] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:14.931227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.937958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 817/1626] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:14 2022] PUT /identity/v3/projects/735a2b40252b44d3b6c136d2d263c9a3/users/a49c84ba4b27431f827bdc9aa8a81f9f/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:14.942163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:14.956984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb404-67cd-4f9b-95bd-84ec1fc2a55e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.015106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:15.067652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece4eb8-fff9-4c5b-9f90-71b8cd895d0d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.077198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.078048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.078178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.078395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.079046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.081263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.107860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 818/1627] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:41:15.108819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:15.109653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e8386-3608-4e56-ba28-118625618700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.111529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8386-3608-4e56-ba28-118625618700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.111924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8386-3608-4e56-ba28-118625618700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.112096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e8386-3608-4e56-ba28-118625618700 admin admin] PATH_INFO: `/v3/projects/460cad8da86145f684615b76699d3fe1/users/3e2d697fd845478187a788a742a1c17c/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.132027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111f446b-821d-4941-b0d5-2c3addbe7665 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.149256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c16dbc-44f2-4581-8bea-4e0400075f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.149991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c16dbc-44f2-4581-8bea-4e0400075f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.150562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c16dbc-44f2-4581-8bea-4e0400075f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.150562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c16dbc-44f2-4581-8bea-4e0400075f9c admin admin] PATH_INFO: `/v3/projects/735a2b40252b44d3b6c136d2d263c9a3/users/a49c84ba4b27431f827bdc9aa8a81f9f/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.166190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c16dbc-44f2-4581-8bea-4e0400075f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=735a2b40252b44d3b6c136d2d263c9a3, user_id=a49c84ba4b27431f827bdc9aa8a81f9f, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.169256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c16dbc-44f2-4581-8bea-4e0400075f9c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.180638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e8386-3608-4e56-ba28-118625618700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460cad8da86145f684615b76699d3fe1, user_id=3e2d697fd845478187a788a742a1c17c, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.183805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e8386-3608-4e56-ba28-118625618700 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.193536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 819/1628] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:15 2022] PUT /identity/v3/projects/735a2b40252b44d3b6c136d2d263c9a3/users/a49c84ba4b27431f827bdc9aa8a81f9f/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:15.205898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc422e-2c37-4eb0-90b7-a1ad1f098d96 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.206099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc422e-2c37-4eb0-90b7-a1ad1f098d96 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.206366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc422e-2c37-4eb0-90b7-a1ad1f098d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.221849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 810/1629] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:14 2022] PUT /identity/v3/projects/460cad8da86145f684615b76699d3fe1/users/3e2d697fd845478187a788a742a1c17c/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:15.223697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd8d7-7643-4b99-9748-a0bed72211b4 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.224912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd8d7-7643-4b99-9748-a0bed72211b4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.225191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd8d7-7643-4b99-9748-a0bed72211b4 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.234368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 811/1630] 10.222.0.67 () {54 vars in 912 bytes} [Mon Aug 29 23:41:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:15.235320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd8d7-7643-4b99-9748-a0bed72211b4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:15.265128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e4bc422e-2c37-4eb0-90b7-a1ad1f098d96 None None] MFA Rules not processed for user `a49c84ba4b27431f827bdc9aa8a81f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:15.266421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e4bc422e-2c37-4eb0-90b7-a1ad1f098d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:15.372866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 820/1631] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:15.374240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.374852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.375136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.388919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd8d7-7643-4b99-9748-a0bed72211b4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.403251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.403889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.404166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.404438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.405101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.406814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.420058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:15.421325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:15.425215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 812/1632] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:15.426180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:15.523546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:15.554171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18046df-4161-4138-8555-6b3245b6edc2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.562964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.563589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.563873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.564143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.575722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 821/1633] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:41:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:15.576611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:15.587686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.589137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.602745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48957d-aba2-4955-88e3-4fc9e7f6e305 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.603162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 813/1634] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:15.604027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:15.613231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4827-8479-4096-ab71-ff73f82f6403 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.613995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.615212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.615503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.615780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] PATH_INFO: `/v3/projects/460cad8da86145f684615b76699d3fe1/users/3e2d697fd845478187a788a742a1c17c/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.618288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abec97-7184-4052-83df-55ca587c4b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.619135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abec97-7184-4052-83df-55ca587c4b46 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.619734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abec97-7184-4052-83df-55ca587c4b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.620305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abec97-7184-4052-83df-55ca587c4b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.624525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460cad8da86145f684615b76699d3fe1, user_id=3e2d697fd845478187a788a742a1c17c, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.632880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.633776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abec97-7184-4052-83df-55ca587c4b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:15.635457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abec97-7184-4052-83df-55ca587c4b46 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:15.664264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 814/1636] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:15.673394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 822/1636] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:15 2022] PUT /identity/v3/projects/460cad8da86145f684615b76699d3fe1/users/3e2d697fd845478187a788a742a1c17c/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:15.676163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.676690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.677944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:15.749258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] MFA Rules not processed for user `3e2d697fd845478187a788a742a1c17c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:15.753119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:15.814641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:15.855767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:15.957169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 815/1637] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:15.969752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed972e09-462f-4227-aa09-30c430360ba3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:15.987745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:15.988281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:15.988562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:15.988832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:16.099987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:16.101632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:16.113792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 823/1638] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:41:16.391461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:16.409494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deaadea-31bc-4ef3-862c-c75a66ca584d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:16.421122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5cb82b-8b1a-4db1-b925-31e8f5f52127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:16.421861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb82b-8b1a-4db1-b925-31e8f5f52127 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:16.422141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb82b-8b1a-4db1-b925-31e8f5f52127 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:16.422469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5cb82b-8b1a-4db1-b925-31e8f5f52127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:16.442967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cb82b-8b1a-4db1-b925-31e8f5f52127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:16.444505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5cb82b-8b1a-4db1-b925-31e8f5f52127 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:16.468172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 816/1639] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:41:16.792345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:16.806969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734659ef-0a48-4d40-914e-302b143a978a service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:16.817021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739f060-47e3-4ed5-b90a-fe894262feac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:16.820113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f060-47e3-4ed5-b90a-fe894262feac service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:16.820403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f060-47e3-4ed5-b90a-fe894262feac service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:16.821938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f060-47e3-4ed5-b90a-fe894262feac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:16.999877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f060-47e3-4ed5-b90a-fe894262feac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:17.001366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f060-47e3-4ed5-b90a-fe894262feac service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:17.019700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 824/1640] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:17.345930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8e8f-d181-4b63-a05c-55a1ece9a453 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:17.345930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8e8f-d181-4b63-a05c-55a1ece9a453 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:17.345930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a8e8f-d181-4b63-a05c-55a1ece9a453 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:17.345930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 817/1641] 10.222.0.67 () {54 vars in 962 bytes} [Mon Aug 29 23:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:17.346867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00562-9baa-412f-a8f7-38f69cf82941 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:17.346867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00562-9baa-412f-a8f7-38f69cf82941 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:17.346867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db00562-9baa-412f-a8f7-38f69cf82941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:17.368287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5db00562-9baa-412f-a8f7-38f69cf82941 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:17.370032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5db00562-9baa-412f-a8f7-38f69cf82941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:17.415370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:17.578907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 825/1642] 10.222.0.67 () {58 vars in 1059 bytes} [Mon Aug 29 23:41:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:17.589322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bb9b5-cfaa-4bb8-8b5b-48104a589450 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:17.589880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bb9b5-cfaa-4bb8-8b5b-48104a589450 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:17.589973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1bb9b5-cfaa-4bb8-8b5b-48104a589450 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:17.591418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 818/1643] 10.222.0.67 () {54 vars in 912 bytes} [Mon Aug 29 23:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:17.600786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:17.600786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:17.600786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:17.644190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:17.653567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:17.676452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 826/1644] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:41:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:18.344701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bb9b5-cfaa-4bb8-8b5b-48104a589450 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:18.369334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1bb9b5-cfaa-4bb8-8b5b-48104a589450 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:18.380072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51031d-c4b3-41e6-888a-45b353623dde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:18.380723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51031d-c4b3-41e6-888a-45b353623dde service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:18.381008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51031d-c4b3-41e6-888a-45b353623dde service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:18.381276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51031d-c4b3-41e6-888a-45b353623dde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:18.432950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51031d-c4b3-41e6-888a-45b353623dde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:18.434796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51031d-c4b3-41e6-888a-45b353623dde service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:18.472922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 819/1645] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:22.470836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:22.633158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e939a1-e613-402b-addf-f5b9b208ca9d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:22.653388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:22.657448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:22.657816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:22.658110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] PATH_INFO: `/v3/users/77f0f626092648b9a700d9778c8ac453` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:22.660956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f0f626092648b9a700d9778c8ac453)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:22.664637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: WARNING py.warnings [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:41:22.664637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: warnings.warn(msg) Aug 29 23:41:22.664637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: Aug 29 23:41:22.667773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:22.777952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f0f626092648b9a700d9778c8ac453'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:22.812502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f0f626092648b9a700d9778c8ac453'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:22.857372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f0f626092648b9a700d9778c8ac453'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:22.858197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f0f626092648b9a700d9778c8ac453'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:22.858841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f0f626092648b9a700d9778c8ac453'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:22.891860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 827/1646] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:22 2022] DELETE /identity/v3/users/77f0f626092648b9a700d9778c8ac453 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:22.894630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:22.895159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:22.895237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:22.930569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:22.931840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:23.039238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 820/1647] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:23.052713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:23.054853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:23.116409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:23.207239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de774fd4-ae73-47a0-a282-c34f7d4d0209 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:23.230120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b9f82-4abb-40b1-b6fc-f5712e5f9eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:23.230519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9f82-4abb-40b1-b6fc-f5712e5f9eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:23.230778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9f82-4abb-40b1-b6fc-f5712e5f9eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:23.231051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b9f82-4abb-40b1-b6fc-f5712e5f9eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:23.258260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b9f82-4abb-40b1-b6fc-f5712e5f9eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:23.259742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b9f82-4abb-40b1-b6fc-f5712e5f9eb9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:23.283937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 828/1648] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:24.746126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:24.747588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:24.776058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7e448-98d7-4eb6-844a-35baca9301c0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:24.807248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:24.807956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:24.808338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:24.808618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] PATH_INFO: `/v3/projects/bfa215968d104866b553cd15ccfc8e12` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:24.810669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa215968d104866b553cd15ccfc8e12)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:24.811790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: WARNING py.warnings [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 29 23:41:24.811790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: warnings.warn(msg) Aug 29 23:41:24.811790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: Aug 29 23:41:24.813077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:24.999684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa215968d104866b553cd15ccfc8e12', 'request_id': 'req-d869e216-358e-4c5e-b388-c3f486e23c69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:25.029263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa215968d104866b553cd15ccfc8e12', 'request_id': 'req-d869e216-358e-4c5e-b388-c3f486e23c69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:25.043605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa215968d104866b553cd15ccfc8e12', 'request_id': 'req-d869e216-358e-4c5e-b388-c3f486e23c69'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:25.089136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] The token cache is being invalidate because project bfa215968d104866b553cd15ccfc8e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:25.089463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:25.091445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d869e216-358e-4c5e-b388-c3f486e23c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:25.097457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 821/1649] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:24 2022] DELETE /identity/v3/projects/bfa215968d104866b553cd15ccfc8e12 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:25.102754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945cc2-ca1b-4c2a-b0a4-077335984850 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:25.103605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945cc2-ca1b-4c2a-b0a4-077335984850 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:25.104022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945cc2-ca1b-4c2a-b0a4-077335984850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:25.147288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-26945cc2-ca1b-4c2a-b0a4-077335984850 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:25.148624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-26945cc2-ca1b-4c2a-b0a4-077335984850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:25.259790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:25.260272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:25.260697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:25.337478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 829/1650] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:25.339242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:25.339679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:25.340085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:25.348402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] MFA Rules not processed for user `06a40ad8ffc847028888ecda6221fcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:25.350462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:25.379656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:25.381731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:25.405848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 830/1651] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:25.410468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:25.420514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:25.424516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9b80b-5cf6-48e3-a0f6-ae83d744cb7c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:25.440949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:25.442182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:25.443202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:25.443620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:25.444433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:25.444880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:25.449848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:25.480775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 831/1652] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:25.485088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:25.502453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea316f5-76d6-44ad-8bfe-7990b131cf8f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:25.522178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:25.523064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:25.523498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:25.524493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:25.525311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:25.529577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:25.593298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 832/1653] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:25 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:41:25.597230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:25.669864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 822/1654] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:25.671713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:25.673914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:25.846698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d7816-9a05-450d-994f-9b1cb2308679 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:25.874032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:25.874946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:25.875451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:25.875947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:25.876837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:25.883960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:25.932888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f93f2b-e597-43fd-a389-dbb9b0d6cbd3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:25.994692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 833/1655] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:25 2022] POST /identity/v3/users => generated 283 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:41:25.996879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:26.027163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5797ec1-4111-4268-b2e2-f2c353148efc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:26.057877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:26.059359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:26.061763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:26.062488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:26.063623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:26.070213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:26.122603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 834/1656] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:26.132534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:26.144216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:26.165753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcae441-6570-4cac-84d1-779698c93fdf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:26.188202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:26.189220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:26.190110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:26.190614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:26.191564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:26.193264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb650b-b18f-47f5-bd75-00e7ae347f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:26.194931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:26.196829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb650b-b18f-47f5-bd75-00e7ae347f0a service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:26.197233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb650b-b18f-47f5-bd75-00e7ae347f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:26.198584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb650b-b18f-47f5-bd75-00e7ae347f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:26.235684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 835/1657] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:26.243077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:26.276091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b262333-4ce6-4925-8f2a-33697f5a41be admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:26.286469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:26.287420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:26.287709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:26.288025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] PATH_INFO: `/v3/projects/4e2d5ec12fa94f648cf7e0580f9984b8/users/b27f0145a4af47f7884be280267ff800/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:26.363296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:26.369046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e2d5ec12fa94f648cf7e0580f9984b8, user_id=b27f0145a4af47f7884be280267ff800, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:26.379517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:26.381542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb650b-b18f-47f5-bd75-00e7ae347f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:26.385339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb650b-b18f-47f5-bd75-00e7ae347f0a service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:26.415071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 823/1658] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:26.469318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:26.469637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:26.469912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:26.472257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 836/1659] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:26 2022] PUT /identity/v3/projects/4e2d5ec12fa94f648cf7e0580f9984b8/users/b27f0145a4af47f7884be280267ff800/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:26.545734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] MFA Rules not processed for user `b27f0145a4af47f7884be280267ff800`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:26.546987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:26.740082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 824/1660] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:26.740260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:27.111117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842ac0b-6fb2-45d6-ab1b-bd22015eeea8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:27.148793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:27.154087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:27.161247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:27.163107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:27.166202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:27.177365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:27.333435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 837/1661] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:26 2022] POST /identity/v3/projects => generated 363 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:27.338136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:27.367137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32977a-725a-47a7-af90-fbf14c08b40e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:27.545958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:27.546650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:27.546929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:27.547245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:27.549044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:27.554066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:27.601440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 825/1662] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:27 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:27.603089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:27.623360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a728abb-d673-4d37-a427-25a4703dc0e3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:27.641521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:27.646504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:27.650204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:27.650551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:27.652171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:27.656001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:27.709919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:27.719780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 838/1663] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:27.725190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d1551-6e3b-410b-8dd8-ed260ac1f3a5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:27.738311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:27.741888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:27.742236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:27.742626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] PATH_INFO: `/v3/projects/7ed677aabed64e34b94575bef42d44f6/users/c269878a03274670a8c891484bd52e50/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:27.795083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed677aabed64e34b94575bef42d44f6, user_id=c269878a03274670a8c891484bd52e50, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:27.798273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:27.860406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 826/1664] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:27 2022] PUT /identity/v3/projects/7ed677aabed64e34b94575bef42d44f6/users/c269878a03274670a8c891484bd52e50/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:27.864065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:27.884916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a95ca-a2c4-42ad-968c-51e700ffbbf9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:28.085879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e019ce-60c0-4bd4-a047-a8e2306b676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:28.089172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e019ce-60c0-4bd4-a047-a8e2306b676c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:28.089595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e019ce-60c0-4bd4-a047-a8e2306b676c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:28.089890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e019ce-60c0-4bd4-a047-a8e2306b676c admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:28.090732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e019ce-60c0-4bd4-a047-a8e2306b676c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:28.092401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e019ce-60c0-4bd4-a047-a8e2306b676c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:28.125412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 839/1665] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:28.130488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:28.153516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ca473f-c92c-404f-ba66-7e4dd805f9fa admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:28.166299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805984e-9067-4108-8579-6507b360595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:28.167302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805984e-9067-4108-8579-6507b360595f admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:28.168597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805984e-9067-4108-8579-6507b360595f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:28.170077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805984e-9067-4108-8579-6507b360595f admin admin] PATH_INFO: `/v3/projects/7ed677aabed64e34b94575bef42d44f6/users/c269878a03274670a8c891484bd52e50/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:28.176817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805984e-9067-4108-8579-6507b360595f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed677aabed64e34b94575bef42d44f6, user_id=c269878a03274670a8c891484bd52e50, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:28.180352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805984e-9067-4108-8579-6507b360595f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:28.225268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 827/1666] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:28 2022] PUT /identity/v3/projects/7ed677aabed64e34b94575bef42d44f6/users/c269878a03274670a8c891484bd52e50/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:28.236198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867702d-6728-425d-b41b-640b45820c67 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:28.236756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867702d-6728-425d-b41b-640b45820c67 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:28.236887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867702d-6728-425d-b41b-640b45820c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:28.319551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3867702d-6728-425d-b41b-640b45820c67 None None] MFA Rules not processed for user `c269878a03274670a8c891484bd52e50`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:28.320808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3867702d-6728-425d-b41b-640b45820c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:28.393728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:28.569285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 840/1667] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:28.594415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805984e-9067-4108-8579-6507b360595f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:28.599755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5805984e-9067-4108-8579-6507b360595f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:28.702619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:28.774483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805984e-9067-4108-8579-6507b360595f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:28.785544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a5b2d-3f53-4fa5-bff8-7421ca2be130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:28.786815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a5b2d-3f53-4fa5-bff8-7421ca2be130 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:28.787938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a5b2d-3f53-4fa5-bff8-7421ca2be130 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:28.788559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a5b2d-3f53-4fa5-bff8-7421ca2be130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:28.806251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a5b2d-3f53-4fa5-bff8-7421ca2be130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:28.807940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a5b2d-3f53-4fa5-bff8-7421ca2be130 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:28.820259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 828/1668] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:28.852567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867702d-6728-425d-b41b-640b45820c67 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:28.854433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3867702d-6728-425d-b41b-640b45820c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:29.058344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867702d-6728-425d-b41b-640b45820c67 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:29.075138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:29.075798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:29.076084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:29.076363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] PATH_INFO: `/v3/users/5a17f87b54ad4bdbb037f32e237b3925` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:29.078339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a17f87b54ad4bdbb037f32e237b3925)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:29.082003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:29.205472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a17f87b54ad4bdbb037f32e237b3925'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:29.230293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a17f87b54ad4bdbb037f32e237b3925'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:29.266539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a17f87b54ad4bdbb037f32e237b3925'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:29.267964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a17f87b54ad4bdbb037f32e237b3925'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:29.268763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a17f87b54ad4bdbb037f32e237b3925'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:29.313536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 841/1669] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:28 2022] DELETE /identity/v3/users/5a17f87b54ad4bdbb037f32e237b3925 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:29.318067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2197ce-7d50-470f-b58c-5c5a130928dd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:29.318509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2197ce-7d50-470f-b58c-5c5a130928dd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:29.318928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2197ce-7d50-470f-b58c-5c5a130928dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:29.355220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7a2197ce-7d50-470f-b58c-5c5a130928dd None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:29.360221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7a2197ce-7d50-470f-b58c-5c5a130928dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:29.579133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 829/1670] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:29.618296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:29.619805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:29.773174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:29.774203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:29.774765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:29.843153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] MFA Rules not processed for user `d90000dd2b094facafada1ada1c8573f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:29.848393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:29.884204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:29.953971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4faa96d-4871-41a7-a070-2c05fb20e03d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:29.979772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:29.982745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:29.983404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:29.983825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:30.021841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:30.028099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:30.061575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 842/1671] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:30.063895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:30.069146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.076293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 830/1672] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:30.091532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:30.093655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.106827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48afc-a1c8-4290-8b68-f2feb16a63a8 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:30.124849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:30.127262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:30.127796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:30.128804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] PATH_INFO: `/v3/users/b27f0145a4af47f7884be280267ff800` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:30.132739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b27f0145a4af47f7884be280267ff800)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:30.138841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:30.275723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b27f0145a4af47f7884be280267ff800'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:30.298275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b27f0145a4af47f7884be280267ff800'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:30.334909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b27f0145a4af47f7884be280267ff800'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:30.337613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b27f0145a4af47f7884be280267ff800'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:30.339126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5d13fc65-ee83-4fdd-8f3c-9635b366558e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b27f0145a4af47f7884be280267ff800'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:30.375316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 843/1673] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:30 2022] DELETE /identity/v3/users/b27f0145a4af47f7884be280267ff800 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:30.379011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4fd9a-bc25-4556-bd3c-1632e882d9dd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:30.380238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4fd9a-bc25-4556-bd3c-1632e882d9dd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:30.380767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4fd9a-bc25-4556-bd3c-1632e882d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:30.381751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:30.395169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f9f0e-7bae-4907-af3c-e0675f414b60 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:30.478193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-63a4fd9a-bc25-4556-bd3c-1632e882d9dd None None] MFA Rules not processed for user `d94d22c104a84a20b764557b2e4a94de`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:30.480170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-63a4fd9a-bc25-4556-bd3c-1632e882d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.639500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:30.640133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:30.640787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:30.640787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:30.650261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.688882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 844/1674] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:30.692456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:30.693588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:30.693986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:30.746500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:30.749328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.836856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:30.839749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79726e2e-3e7b-4036-872c-39b4c959410f service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:30.862856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 831/1675] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:41:30.865053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:30.865504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:30.865911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:30.900718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:30.923090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] MFA Rules not processed for user `d94d22c104a84a20b764557b2e4a94de`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:30.924615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.937465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 832/1676] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:30.949080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:30.951448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 845/1677] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:30.952407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.963366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:30.965179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:30.990474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e1599-1af6-42eb-8b37-4325d7154438 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:31.010956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:31.011698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:31.011984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:31.012254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:31.031530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:31.033241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:31.086096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 833/1678] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:41:31.171732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5b043-d7a2-4625-94a6-14bfd3e6b569 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:31.183701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6064e-2d86-4414-a15e-b99385418cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:31.186088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6064e-2d86-4414-a15e-b99385418cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:31.187674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6064e-2d86-4414-a15e-b99385418cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:31.188177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6064e-2d86-4414-a15e-b99385418cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:31.223681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6064e-2d86-4414-a15e-b99385418cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:31.231121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6064e-2d86-4414-a15e-b99385418cc1 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:31.280442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 846/1679] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:32.154748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:32.162345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:32.201654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f67fa0-367f-4dc6-8a57-61d2caad7649 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:32.215934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:32.217256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.217919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.218532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] PATH_INFO: `/v3/projects/df0bf1b0c20c47f982c07085aecc50a3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.220883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0bf1b0c20c47f982c07085aecc50a3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:32.227515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:32.339740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0bf1b0c20c47f982c07085aecc50a3', 'request_id': 'req-e58afd94-b84a-4584-9afc-580ca322ea29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:32.355360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0bf1b0c20c47f982c07085aecc50a3', 'request_id': 'req-e58afd94-b84a-4584-9afc-580ca322ea29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:32.362280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0bf1b0c20c47f982c07085aecc50a3', 'request_id': 'req-e58afd94-b84a-4584-9afc-580ca322ea29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:32.389874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] The token cache is being invalidate because project df0bf1b0c20c47f982c07085aecc50a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:32.390285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:32.391110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e58afd94-b84a-4584-9afc-580ca322ea29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:32.393203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 834/1680] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:32 2022] DELETE /identity/v3/projects/df0bf1b0c20c47f982c07085aecc50a3 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:32.398777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64649-caef-4bd8-834f-582841623c84 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.400409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64649-caef-4bd8-834f-582841623c84 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.400868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e64649-caef-4bd8-834f-582841623c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.443567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-39e64649-caef-4bd8-834f-582841623c84 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:32.445174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-39e64649-caef-4bd8-834f-582841623c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:32.592095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 847/1681] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:32.594706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4b8aa-0f3f-43c4-ac66-87f640e4de21 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.594706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4b8aa-0f3f-43c4-ac66-87f640e4de21 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.594938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4b8aa-0f3f-43c4-ac66-87f640e4de21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.604767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:32.624804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4ca4b8aa-0f3f-43c4-ac66-87f640e4de21 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:32.626149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ca4b8aa-0f3f-43c4-ac66-87f640e4de21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:32.637912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 835/1682] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:32.639933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64649-caef-4bd8-834f-582841623c84 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:32.651351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e64649-caef-4bd8-834f-582841623c84 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:32.655666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513e1b-f643-4691-b58a-3f073e27fe8e None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.656151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513e1b-f643-4691-b58a-3f073e27fe8e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.656570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04513e1b-f643-4691-b58a-3f073e27fe8e None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.658827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:32.658972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.659269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.659963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 836/1683] 10.222.0.67 () {54 vars in 912 bytes} [Mon Aug 29 23:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:32.661439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.662189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:32.662556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:32.664414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.664533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:32.664935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.665543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.685262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 848/1684] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:32.687673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:32.705806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840a693-6a6b-4156-9113-52fd02eaca01 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:32.734889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:32.737930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:32.738314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:32.739266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:32.741887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:32.748906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:32.835690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] MFA Rules not processed for user `e0b4196792fe44f2a8fb31bba5a6006e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:32.837058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:32.870533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 849/1685] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:32 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:32.878630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.087701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 837/1686] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:41:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:33.101094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.110256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:33.197915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96cc66-837f-4094-b5cc-5c123ccac8ad None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.209716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:33.231604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.237900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.238061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.238298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] PATH_INFO: `/v3/projects/4e2d5ec12fa94f648cf7e0580f9984b8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.240141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f8d25-2cd9-4571-8e51-aad9b8f2ec2b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.240971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e2d5ec12fa94f648cf7e0580f9984b8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.253881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.255627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.257507 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.258140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.258437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.261209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.271073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.343508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 850/1687] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:32 2022] POST /identity/v3/users => generated 288 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:33.347277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.377188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e417a-9253-4d4f-b287-d60e97a1b299 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.401676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e2d5ec12fa94f648cf7e0580f9984b8', 'request_id': 'req-e244922b-c317-4036-b39c-3d0aa41aab42'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.413429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e2d5ec12fa94f648cf7e0580f9984b8', 'request_id': 'req-e244922b-c317-4036-b39c-3d0aa41aab42'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.437600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e2d5ec12fa94f648cf7e0580f9984b8', 'request_id': 'req-e244922b-c317-4036-b39c-3d0aa41aab42'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.449660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] The token cache is being invalidate because project 4e2d5ec12fa94f648cf7e0580f9984b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:33.449955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.450814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.453653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 838/1688] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:33 2022] DELETE /identity/v3/projects/4e2d5ec12fa94f648cf7e0580f9984b8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:33.454395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.457416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:33.573749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244922b-c317-4036-b39c-3d0aa41aab42 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.577865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.578684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.578972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.579245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.581037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:33.603388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.605248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.606146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.606855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.607054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.607325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.607977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.609614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.619705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 839/1689] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:33.620927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.623012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:33.641000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d4de0-3a08-4724-8ee2-459d731fe928 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.643959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 851/1690] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:33.648834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.649039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.650267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.650556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.650885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] PATH_INFO: `/v3/users/c269878a03274670a8c891484bd52e50` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.659199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:33.665931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c269878a03274670a8c891484bd52e50)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.668684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.703744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ecac-214a-4be1-9106-a1e7498f5887 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.713738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:33.721949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.722402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.722687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.722993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.724176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.725915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.763676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 852/1691] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:33.765133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:33.796626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c269878a03274670a8c891484bd52e50'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.806596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500171f6-c932-4612-af1f-f8748d919018 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:33.815938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c269878a03274670a8c891484bd52e50'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.832507 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:33.833762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.834284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.834559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] PATH_INFO: `/v3/projects/1bce8602b7b24b78a9a38ac0d571f0d0/users/fa705a425fbb4b56af31fef45888d620/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:33.842331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c269878a03274670a8c891484bd52e50'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.844609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c269878a03274670a8c891484bd52e50'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.875952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d98278fe-6258-4c86-a1a5-3f95f8942282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c269878a03274670a8c891484bd52e50'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:33.887490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce8602b7b24b78a9a38ac0d571f0d0, user_id=fa705a425fbb4b56af31fef45888d620, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:33.899800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:33.900927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 840/1692] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:33 2022] DELETE /identity/v3/users/c269878a03274670a8c891484bd52e50 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:33.938969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 853/1693] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:33 2022] PUT /identity/v3/projects/1bce8602b7b24b78a9a38ac0d571f0d0/users/fa705a425fbb4b56af31fef45888d620/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:33.940436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0a23-57ac-4a32-a44c-c812cbbcf23d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:33.940739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0a23-57ac-4a32-a44c-c812cbbcf23d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:33.941022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec0a23-57ac-4a32-a44c-c812cbbcf23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:34.013190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2cec0a23-57ac-4a32-a44c-c812cbbcf23d None None] MFA Rules not processed for user `fa705a425fbb4b56af31fef45888d620`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:34.014502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2cec0a23-57ac-4a32-a44c-c812cbbcf23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:34.228872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 841/1694] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:34.243855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:34.245812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:34.466236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe6a9d-1def-495f-ad2e-55d77fbc3b8c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:34.481025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d4ade-5244-4186-a65e-dd904e4ee812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:34.481805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4ade-5244-4186-a65e-dd904e4ee812 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:34.482154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4ade-5244-4186-a65e-dd904e4ee812 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:34.482517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d4ade-5244-4186-a65e-dd904e4ee812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:34.498179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4ade-5244-4186-a65e-dd904e4ee812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:34.499962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d4ade-5244-4186-a65e-dd904e4ee812 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:34.512085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 854/1695] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:34.615687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:34.616233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:34.616429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:34.668603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] MFA Rules not processed for user `06a40ad8ffc847028888ecda6221fcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:34.673014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:34.869519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 842/1696] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:35.278152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9536-f6b3-4646-af93-80d6626ca3e0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:35.278624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9536-f6b3-4646-af93-80d6626ca3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:35.278703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc9536-f6b3-4646-af93-80d6626ca3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:35.413389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3ecc9536-f6b3-4646-af93-80d6626ca3e0 None None] MFA Rules not processed for user `7b153ae4d44c452689451adf19c680b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:35.416021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3ecc9536-f6b3-4646-af93-80d6626ca3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:35.488006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:35.501660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:35.505911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:35.639696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 855/1697] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:35.649697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:35.649992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:35.650272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:35.700559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:35.712959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] MFA Rules not processed for user `7b153ae4d44c452689451adf19c680b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:35.716788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:35.750621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 856/1698] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 29 23:41:35.753136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:35.755633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:35.810670 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307cb34-6009-4a37-a751-775c28d3873b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:35.825691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:35.826367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:35.826651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:35.826923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] PATH_INFO: `/v3/projects/7ed677aabed64e34b94575bef42d44f6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:35.828797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed677aabed64e34b94575bef42d44f6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:35.837744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:35.933176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d39b25-5947-4b8c-a15e-e2a7cf4bb691 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:35.947694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed677aabed64e34b94575bef42d44f6', 'request_id': 'req-1065e9b0-621d-429e-a195-b1225f040834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:35.963477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed677aabed64e34b94575bef42d44f6', 'request_id': 'req-1065e9b0-621d-429e-a195-b1225f040834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:35.976828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed677aabed64e34b94575bef42d44f6', 'request_id': 'req-1065e9b0-621d-429e-a195-b1225f040834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.002720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] The token cache is being invalidate because project 7ed677aabed64e34b94575bef42d44f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:36.003051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.003958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.010136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 843/1699] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:35 2022] DELETE /identity/v3/projects/7ed677aabed64e34b94575bef42d44f6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:36.011516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.013213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.076953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:36.077759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.078036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.078301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] PATH_INFO: `/v3/users/fa705a425fbb4b56af31fef45888d620` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.079460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa705a425fbb4b56af31fef45888d620)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:36.089214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:36.231474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa705a425fbb4b56af31fef45888d620'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.237409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065e9b0-621d-429e-a195-b1225f040834 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:36.255390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa705a425fbb4b56af31fef45888d620'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.258057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:36.258700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.258984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.259255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.262872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.269300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:36.290151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa705a425fbb4b56af31fef45888d620'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.290863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa705a425fbb4b56af31fef45888d620'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.291902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:36.293876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856b937b-0acf-428a-8206-d0653b79f8a6 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:36.294855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa705a425fbb4b56af31fef45888d620'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:36.320781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 857/1700] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:35 2022] DELETE /identity/v3/users/fa705a425fbb4b56af31fef45888d620 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:36.322858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.327015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.331413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 844/1701] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:36.332858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51463e7-b730-4c8e-abaa-e31ed0706370 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.333145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51463e7-b730-4c8e-abaa-e31ed0706370 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.333451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51463e7-b730-4c8e-abaa-e31ed0706370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.382598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d51463e7-b730-4c8e-abaa-e31ed0706370 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:36.384115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d51463e7-b730-4c8e-abaa-e31ed0706370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.480985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:36.488368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec08fd-56e0-41c8-90a6-f7d60ecbf6b7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:36.495714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:36.496502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.496791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.497068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.499744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.521388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 845/1702] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:36.521388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e50d-1277-414c-a95f-928b9c508ddf None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.521388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e50d-1277-414c-a95f-928b9c508ddf None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.521388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650e50d-1277-414c-a95f-928b9c508ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.545710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0650e50d-1277-414c-a95f-928b9c508ddf None None] MFA Rules not processed for user `d90000dd2b094facafada1ada1c8573f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:36.547289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0650e50d-1277-414c-a95f-928b9c508ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.669437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 846/1703] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:36.669437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c97c6-75e5-406f-8e28-4bb05954e3b7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.669437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c97c6-75e5-406f-8e28-4bb05954e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.670549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c97c6-75e5-406f-8e28-4bb05954e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.678100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:36.681198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c4ea3-3a9d-47fc-bb34-3c2e9d351d28 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:36.696371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 858/1704] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:36.699088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529c2e-6981-4fde-986f-d390bc55b1a9 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.699808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529c2e-6981-4fde-986f-d390bc55b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.700262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42529c2e-6981-4fde-986f-d390bc55b1a9 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.703699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 859/1705] 10.222.0.67 () {54 vars in 912 bytes} [Mon Aug 29 23:41:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:36.705911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.706511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.707116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.709396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-592c97c6-75e5-406f-8e28-4bb05954e3b7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:36.713856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-592c97c6-75e5-406f-8e28-4bb05954e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.736984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:36.738137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 847/1706] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:36.739536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.740155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.740518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.740869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.763015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 860/1707] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:36.766345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.770917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.772964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] MFA Rules not processed for user `e0b4196792fe44f2a8fb31bba5a6006e`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:36.774227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:36.869674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 848/1708] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:41:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:36.870939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.913056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a0fc4-8bed-4849-a733-9056537cf877 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:36.928968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baab7dd-27f6-4574-ab70-961a7eb2966a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:36.935236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:36.936985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.939453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.939845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.947077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:36.947717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:36.948166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:36.948271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:36.948992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:36.949233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:36.951129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:36.976685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:36.978249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:36.994963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 861/1709] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:36.995886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:36.997547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:37.011293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3540-6ca8-41a9-9bba-eb25aa3fb026 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.015851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.016584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.016999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.017277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.025693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 849/1710] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:37.031108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.036429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.038252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.046502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:37.052753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b68307-e96a-4b95-bea4-d405f02fe673 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.077776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 862/1711] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:37.086112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.086748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.087028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.087318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.087942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.091592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.152955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 850/1712] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:37 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:37.157530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.175324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b02ee1-9c55-45c2-a768-17f5b6dd9d34 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.353015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.354554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.354846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.355603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.356329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.382830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.420166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 863/1713] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:37 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:37.422202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.439609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca5c59-b7e1-4f1c-93ed-6cc38902e741 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.446571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.447485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.447658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.447986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.449405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.451209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.468647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 851/1714] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:37.469910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.486078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350631b5-c64c-4bf8-9192-9a0bc1ec6111 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.493694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dced2-8074-45fd-99bc-f6d9fb1f8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.494796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dced2-8074-45fd-99bc-f6d9fb1f8014 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.495135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dced2-8074-45fd-99bc-f6d9fb1f8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.495472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dced2-8074-45fd-99bc-f6d9fb1f8014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.496296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dced2-8074-45fd-99bc-f6d9fb1f8014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.498243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372dced2-8074-45fd-99bc-f6d9fb1f8014 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.518045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 864/1715] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:37.520753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:37.539981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d4bdd-3f71-41cd-8af0-fea5485f8fbf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:37.548452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:37.550197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.550756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.551290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] PATH_INFO: `/v3/projects/a4b0fa25c61946078dcebf33b704c158/users/36a9f23336934b488ba23ae80ef843c3/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.601965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b0fa25c61946078dcebf33b704c158, user_id=36a9f23336934b488ba23ae80ef843c3, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:37.610482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:37.664273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 852/1716] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:37 2022] PUT /identity/v3/projects/a4b0fa25c61946078dcebf33b704c158/users/36a9f23336934b488ba23ae80ef843c3/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:37.665599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:37.665891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:37.666484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:37.753923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] MFA Rules not processed for user `36a9f23336934b488ba23ae80ef843c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:37.756149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:37.991889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 865/1717] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:37.996146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.064403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.213471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1612e-d9c7-453f-b652-fc79a9d82104 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.227523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.228638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.228638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.228985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.232126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.242664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.308932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 853/1718] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:37 2022] POST /identity/v3/projects => generated 369 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:41:38.313683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.339146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0b612-c46c-4b98-9839-55e27c097644 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.471944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.474498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:38.585665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.586154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.586436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.586712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.589311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.596815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.661331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:38.680909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 866/1719] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:38 2022] POST /identity/v3/users => generated 291 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:38.684606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84a7a2-0c89-4468-8afb-1e0531297cbb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.686316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.702780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.703452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.704814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.704814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] PATH_INFO: `/v3/projects/1bce8602b7b24b78a9a38ac0d571f0d0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.705757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bce8602b7b24b78a9a38ac0d571f0d0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.708257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.716297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea5c59-b141-4dab-8d5d-de3e56a836de admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.732725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.735204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.735490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.735768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.736437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.742046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.787725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 867/1720] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:38.790978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:38.831313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99394872-dc84-48bd-bdc0-35bf01feeb4d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:38.844212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:38.845103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:38.846696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:38.847062 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] PATH_INFO: `/v3/projects/2564587b811a4a0790edca7530ff3e4e/users/a7a56b2c69974d89b9bdb4ede549695a/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:38.949114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bce8602b7b24b78a9a38ac0d571f0d0', 'request_id': 'req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:38.950150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2564587b811a4a0790edca7530ff3e4e, user_id=a7a56b2c69974d89b9bdb4ede549695a, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:38.956911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:38.980087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bce8602b7b24b78a9a38ac0d571f0d0', 'request_id': 'req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:39.032872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bce8602b7b24b78a9a38ac0d571f0d0', 'request_id': 'req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:39.068254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 868/1721] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:38 2022] PUT /identity/v3/projects/2564587b811a4a0790edca7530ff3e4e/users/a7a56b2c69974d89b9bdb4ede549695a/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:39.074608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:39.087333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] The token cache is being invalidate because project 1bce8602b7b24b78a9a38ac0d571f0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:39.103426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:39.106857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d17e1f58-f8e8-4abf-a2b4-8b437ad4c206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:39.117226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 854/1722] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:38 2022] DELETE /identity/v3/projects/1bce8602b7b24b78a9a38ac0d571f0d0 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:39.124495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a319553-fa90-40c8-afd1-8c2b48dd0569 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:39.124495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a319553-fa90-40c8-afd1-8c2b48dd0569 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:39.126274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a319553-fa90-40c8-afd1-8c2b48dd0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:39.259878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1a319553-fa90-40c8-afd1-8c2b48dd0569 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:39.269785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a319553-fa90-40c8-afd1-8c2b48dd0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:39.392964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3df7-747d-45d8-9c87-bec296959e8a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:39.444386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:39.445048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:39.447191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:39.447527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:39.448327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:39.455017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:39.456509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:39.532866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 869/1723] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:39.540943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:39.571163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:39.592093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 855/1724] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:39.593687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768f98-24c9-4bbe-80e7-38eb94069907 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:39.593985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768f98-24c9-4bbe-80e7-38eb94069907 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:39.594249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768f98-24c9-4bbe-80e7-38eb94069907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:39.627711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c88762-e3b9-449e-870d-79709ddd0308 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:39.649655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642ff4a-c858-4e83-97ad-fac00566ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:39.650332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642ff4a-c858-4e83-97ad-fac00566ed49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:39.650623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642ff4a-c858-4e83-97ad-fac00566ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:39.650887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642ff4a-c858-4e83-97ad-fac00566ed49 admin admin] PATH_INFO: `/v3/projects/2564587b811a4a0790edca7530ff3e4e/users/a7a56b2c69974d89b9bdb4ede549695a/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:39.673035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642ff4a-c858-4e83-97ad-fac00566ed49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2564587b811a4a0790edca7530ff3e4e, user_id=a7a56b2c69974d89b9bdb4ede549695a, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:39.688403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642ff4a-c858-4e83-97ad-fac00566ed49 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:39.688643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-09768f98-24c9-4bbe-80e7-38eb94069907 None None] MFA Rules not processed for user `7b153ae4d44c452689451adf19c680b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:39.696299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-09768f98-24c9-4bbe-80e7-38eb94069907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:39.727801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 870/1725] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:39 2022] PUT /identity/v3/projects/2564587b811a4a0790edca7530ff3e4e/users/a7a56b2c69974d89b9bdb4ede549695a/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:39.740501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:39.748377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:39.748942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:39.798628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:39.816204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:39.932022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 856/1726] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:39.935849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:39.936875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:39.937471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:39.964849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 871/1727] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:39.969196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:39.990608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e36584-1c8e-489e-b1b8-2a4d61f15e93 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:40.007284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:40.007991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.008396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.008750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.010144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:40.010780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:40.013911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:40.020560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] MFA Rules not processed for user `a7a56b2c69974d89b9bdb4ede549695a`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:40.023249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:40.105854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 872/1728] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:41:40.107306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:40.166584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933b374-4ff4-4694-91f0-62a3086fd41b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:40.182071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:40.183219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.183836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.185454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.187118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:40.197118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:40.268628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 873/1729] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:40 2022] POST /identity/v3/projects => generated 393 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:40.270371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:40.273629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:40.306354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 857/1730] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:40.313199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:40.321217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:40.365837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004ae3b-bb92-4659-ace1-4b7f7c7db54f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:40.521289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f912d-cf23-4b7e-bfab-613953e771de admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:40.542075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:40.542812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.544172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.545084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] PATH_INFO: `/v3/users/4d53aef7ffb74ebcb429ea0c4408d94a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.547820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d53aef7ffb74ebcb429ea0c4408d94a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:40.553661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:40.559416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:40.560131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.562973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.563260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.567543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:40.569654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:40.636889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:40.654614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 858/1731] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:40 2022] POST /identity/v3/users => generated 297 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:40.656060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:40.663930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:40.667545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d53aef7ffb74ebcb429ea0c4408d94a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:40.680108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d53aef7ffb74ebcb429ea0c4408d94a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:40.705562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d53aef7ffb74ebcb429ea0c4408d94a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:40.706345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d53aef7ffb74ebcb429ea0c4408d94a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:40.708876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d89f90dc-2d90-4e33-89cc-878047ecf01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d53aef7ffb74ebcb429ea0c4408d94a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:40.731423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 874/1732] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:40 2022] DELETE /identity/v3/users/4d53aef7ffb74ebcb429ea0c4408d94a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:40.732952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:40.733232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:40.733666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:40.821861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:40.833514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:40.887030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67edfa9-c4fd-407e-88b5-935b7abeaf93 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.003204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 875/1733] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:41:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:41.009418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.010690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:41.021195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.022656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:41.024291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.025702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.026665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.032354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:41.187509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6379c-740c-4834-a095-807da95d1d62 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.202611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37fb59-ac22-46d2-b88a-5ddd79eef13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.203239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37fb59-ac22-46d2-b88a-5ddd79eef13b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.203519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37fb59-ac22-46d2-b88a-5ddd79eef13b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.203911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37fb59-ac22-46d2-b88a-5ddd79eef13b admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.204575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37fb59-ac22-46d2-b88a-5ddd79eef13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.206491 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37fb59-ac22-46d2-b88a-5ddd79eef13b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.232712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 876/1734] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:41.234139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.234430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.234704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.244135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.248910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.275605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:41.276862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:41.278546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 859/1735] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:41.280471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.309505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126cf70-f796-447f-a333-2f600db5c13e service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.317186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 877/1736] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:41.338327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.338546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.339287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.339717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.340000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.340739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.340912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:41.342496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.385238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 860/1737] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:41.398591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:41.419024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2329fbb-10cb-4011-930c-81d6d154dfb7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.435231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd85a4f-dd15-4128-a350-10c528e1b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.435914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd85a4f-dd15-4128-a350-10c528e1b0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.436191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd85a4f-dd15-4128-a350-10c528e1b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.436464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd85a4f-dd15-4128-a350-10c528e1b0a1 admin admin] PATH_INFO: `/v3/projects/ee816b532f9b41ceb8ab0df80cd002f7/users/e0d0dd99d47f48a5ba8c3613687ae897/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.477799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd85a4f-dd15-4128-a350-10c528e1b0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee816b532f9b41ceb8ab0df80cd002f7, user_id=e0d0dd99d47f48a5ba8c3613687ae897, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:41.504167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd85a4f-dd15-4128-a350-10c528e1b0a1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:41.582447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 861/1738] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:41 2022] PUT /identity/v3/projects/ee816b532f9b41ceb8ab0df80cd002f7/users/e0d0dd99d47f48a5ba8c3613687ae897/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:41.617747 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.618772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.621665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:41.776440 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b929ae-ea42-418a-9abb-028375a48315 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:41.835765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] MFA Rules not processed for user `e0d0dd99d47f48a5ba8c3613687ae897`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:41.836809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:41.919512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:41.982944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:41.983663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:41.984437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:41.986527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.052463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:42.078312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 862/1739] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:42.081988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.084388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:42.246880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.248759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.279773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6adc9-7914-434c-a3a0-537a915bd41e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.291424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.292023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.292304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.292383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.304145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 878/1740] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:41:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 961 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:41:42.305152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.571089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.575224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.585445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9301a1b-b46e-4d64-bd9b-8cde86aa2e22 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:42.609067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:42.616636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:42.617427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 863/1741] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:42.617934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:42.618515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:42.619949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:42.623267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:42.750056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 879/1742] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:42 2022] POST /identity/v3/projects => generated 391 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:42.751867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:42.775335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262a887-e239-4ef9-ae51-ccd4e6dde598 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:43.111972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:43.113856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:43.117057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:43.125960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:43.125960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:43.125960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:43.176901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:43.186733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 864/1743] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:42 2022] POST /identity/v3/users => generated 302 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:41:43.189542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:43.244287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2dda-76f1-4b00-9c8e-dc91f9fa4164 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:43.271489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:43.275372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:43.275840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:43.288220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:43.290458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:43.308110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:43.389880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:43.398607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 880/1744] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:43.413550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abac539-8572-485a-a5ba-c7db7fe61614 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:43.427772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:43.430744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:43.431250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:43.432816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] PATH_INFO: `/v3/projects/7e448e8f03974aa7b26c337c22c01653/users/b72c8b7e58bd4d1c9079c96fd0389452/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:43.456727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e448e8f03974aa7b26c337c22c01653, user_id=b72c8b7e58bd4d1c9079c96fd0389452, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:43.462400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:43.514029 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 865/1745] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:43 2022] PUT /identity/v3/projects/7e448e8f03974aa7b26c337c22c01653/users/b72c8b7e58bd4d1c9079c96fd0389452/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:43.518746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:43.555857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5474c3-5d9f-467f-ac31-4b559d3df364 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:43.929858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da22b74-a97e-4469-acb5-ed43a17b9976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:43.930741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22b74-a97e-4469-acb5-ed43a17b9976 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:43.931210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22b74-a97e-4469-acb5-ed43a17b9976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:43.931712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da22b74-a97e-4469-acb5-ed43a17b9976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:43.932866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da22b74-a97e-4469-acb5-ed43a17b9976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:43.935141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da22b74-a97e-4469-acb5-ed43a17b9976 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:44.042694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 881/1746] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 521 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:44.045414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:44.090427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110a1f-da03-455f-9311-af209a316d14 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:44.107217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:44.109283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:44.109602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:44.109872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] PATH_INFO: `/v3/projects/7e448e8f03974aa7b26c337c22c01653/users/b72c8b7e58bd4d1c9079c96fd0389452/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:44.119576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e448e8f03974aa7b26c337c22c01653, user_id=b72c8b7e58bd4d1c9079c96fd0389452, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:44.124506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:44.181120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 866/1747] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:44 2022] PUT /identity/v3/projects/7e448e8f03974aa7b26c337c22c01653/users/b72c8b7e58bd4d1c9079c96fd0389452/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:44.195670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbcf11-95c7-4454-ac18-e55b5d618310 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:44.196220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbcf11-95c7-4454-ac18-e55b5d618310 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:44.196317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddbcf11-95c7-4454-ac18-e55b5d618310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:44.262465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9ddbcf11-95c7-4454-ac18-e55b5d618310 None None] MFA Rules not processed for user `b72c8b7e58bd4d1c9079c96fd0389452`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:44.264075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9ddbcf11-95c7-4454-ac18-e55b5d618310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:44.305145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:44.498005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 882/1748] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:44.538332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:44.540358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:44.728690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46469f9d-a724-4a52-949d-da37405c3353 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:44.736432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:44.737509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:44.739113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:44.739828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:44.788239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:44.792583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:44.850460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 867/1749] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:44.856321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:44.856562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:44.856845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:44.977860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] MFA Rules not processed for user `e0b4196792fe44f2a8fb31bba5a6006e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:44.986839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:45.167669 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.180846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8552b-d124-411a-b952-6010a82e9706 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.202548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e81362-2960-419d-994b-616845ad013a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.205003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e81362-2960-419d-994b-616845ad013a service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.212694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e81362-2960-419d-994b-616845ad013a service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.213252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e81362-2960-419d-994b-616845ad013a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.252039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 883/1750] 10.222.0.94 () {58 vars in 1015 bytes} [Mon Aug 29 23:41:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:45.259222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.269308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:45.524876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e81362-2960-419d-994b-616845ad013a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:45.528043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e81362-2960-419d-994b-616845ad013a service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:45.529094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427790b-2afe-4897-9cde-e336d1e7db3f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.544138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.544780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.545037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 868/1751] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:41:45.546016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e81362-2960-419d-994b-616845ad013a service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.547569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.547876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] PATH_INFO: `/v3/projects/38d7e73281d34144be9656bad043477f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.548389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41e81362-2960-419d-994b-616845ad013a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:45.554778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d7e73281d34144be9656bad043477f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:45.561022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:45.588509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e81362-2960-419d-994b-616845ad013a service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:45.604470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:45.606358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:45.606486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:45.606824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:45.625723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:45.630457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:45.661694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 869/1752] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:45.721157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d7e73281d34144be9656bad043477f', 'request_id': 'req-19554a38-3595-4bf3-bd09-180d7d57df13'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:45.750240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d7e73281d34144be9656bad043477f', 'request_id': 'req-19554a38-3595-4bf3-bd09-180d7d57df13'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:45.780726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:45.786529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d7e73281d34144be9656bad043477f', 'request_id': 'req-19554a38-3595-4bf3-bd09-180d7d57df13'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:45.831331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] The token cache is being invalidate because project 38d7e73281d34144be9656bad043477f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:45.831642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:45.850373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:45.861320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 884/1753] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:45 2022] DELETE /identity/v3/projects/38d7e73281d34144be9656bad043477f => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:45.867589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:45.887720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea35df7-f1f0-4514-aabd-c3df9ba81176 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:46.068576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:46.099702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:46.100274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:46.100543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:46.100985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] PATH_INFO: `/v3/users/3e2d697fd845478187a788a742a1c17c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:46.107037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2d697fd845478187a788a742a1c17c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:46.109386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:46.257958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2d697fd845478187a788a742a1c17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:46.293072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2d697fd845478187a788a742a1c17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:46.318804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2d697fd845478187a788a742a1c17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:46.323538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2d697fd845478187a788a742a1c17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:46.350300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1ff4e7e4-5682-484d-a995-e230e41af75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2d697fd845478187a788a742a1c17c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:46.373173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 870/1754] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:45 2022] DELETE /identity/v3/users/3e2d697fd845478187a788a742a1c17c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:47.014317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:47.015936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:47.054550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19554a38-3595-4bf3-bd09-180d7d57df13 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:47.274467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:47.275459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:47.282474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:47.283002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] PATH_INFO: `/v3/users/36a9f23336934b488ba23ae80ef843c3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:47.293612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a9f23336934b488ba23ae80ef843c3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:47.296220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:47.427494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a9f23336934b488ba23ae80ef843c3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:47.441627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a9f23336934b488ba23ae80ef843c3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:47.460280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a9f23336934b488ba23ae80ef843c3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:47.461546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a9f23336934b488ba23ae80ef843c3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:47.463667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a9f23336934b488ba23ae80ef843c3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:47.500966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 885/1755] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:47 2022] DELETE /identity/v3/users/36a9f23336934b488ba23ae80ef843c3 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:47.506644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32724a-3b47-4215-8cfd-b1e6054873f9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:47.507604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32724a-3b47-4215-8cfd-b1e6054873f9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:47.507604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32724a-3b47-4215-8cfd-b1e6054873f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:47.577593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4b32724a-3b47-4215-8cfd-b1e6054873f9 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:47.579207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4b32724a-3b47-4215-8cfd-b1e6054873f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:47.702147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 871/1756] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:47.738901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:47.742044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:47.918715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21efa94-9f09-413c-ae94-f7eab9dac5a8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:47.927216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab747a27-83f1-4fdc-b233-a08c64309cf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:47.930363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab747a27-83f1-4fdc-b233-a08c64309cf9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:47.931355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab747a27-83f1-4fdc-b233-a08c64309cf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:47.931854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab747a27-83f1-4fdc-b233-a08c64309cf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:47.953005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab747a27-83f1-4fdc-b233-a08c64309cf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:47.956815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab747a27-83f1-4fdc-b233-a08c64309cf9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:47.976331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 886/1757] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:49.682731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69fd1-1adc-40f3-a740-73750320fb9d None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:49.683485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69fd1-1adc-40f3-a740-73750320fb9d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:49.684006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb69fd1-1adc-40f3-a740-73750320fb9d None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:49.686221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 872/1758] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:49.834937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:49.836031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:49.836744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:49.888051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:49.889317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:49.912203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:50.070580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 887/1759] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:41:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:50.516608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69fd1-1adc-40f3-a740-73750320fb9d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.521532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fb69fd1-1adc-40f3-a740-73750320fb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:50.547195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.548963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:50.551292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb69fd1-1adc-40f3-a740-73750320fb9d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.559637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.561723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.562301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.562832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.578700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5a08d-cc9f-4a79-8473-2c78bb8a1d28 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:50.592810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:50.595107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:50.596329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:50.597243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.598905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] PATH_INFO: `/v3/projects/a4b0fa25c61946078dcebf33b704c158` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:50.599960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.601991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b0fa25c61946078dcebf33b704c158)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:50.614791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:50.630355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 873/1760] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:50.784134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b0fa25c61946078dcebf33b704c158', 'request_id': 'req-b196ef62-b03d-409e-bf9e-891108d30026'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:50.803685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b0fa25c61946078dcebf33b704c158', 'request_id': 'req-b196ef62-b03d-409e-bf9e-891108d30026'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:50.814202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b0fa25c61946078dcebf33b704c158', 'request_id': 'req-b196ef62-b03d-409e-bf9e-891108d30026'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:50.841641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] The token cache is being invalidate because project a4b0fa25c61946078dcebf33b704c158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:50.842282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:50.844081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:50.844214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.846440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:50.859406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 888/1761] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:50 2022] DELETE /identity/v3/projects/a4b0fa25c61946078dcebf33b704c158 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:50.861682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:50.869559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:50.874119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab5b50-bf7a-41fa-b953-ad5ee07daa1b service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.045112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b196ef62-b03d-409e-bf9e-891108d30026 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.058610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:51.064137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.066313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.068677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.069435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] PATH_INFO: `/v3/users/a7a56b2c69974d89b9bdb4ede549695a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.069701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.070362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.070922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.071759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] PATH_INFO: `/v3/projects/460cad8da86145f684615b76699d3fe1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.075127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] RBAC: Authorizing `identity:delete_project(project_id=460cad8da86145f684615b76699d3fe1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.077092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.077511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a56b2c69974d89b9bdb4ede549695a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.080162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.164392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:51.196809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a56b2c69974d89b9bdb4ede549695a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.213785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a56b2c69974d89b9bdb4ede549695a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.254864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a56b2c69974d89b9bdb4ede549695a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.258706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a56b2c69974d89b9bdb4ede549695a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.263802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a56b2c69974d89b9bdb4ede549695a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.267975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460cad8da86145f684615b76699d3fe1', 'request_id': 'req-5196dd08-e070-4bd2-9491-4a8c36d946de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.284516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460cad8da86145f684615b76699d3fe1', 'request_id': 'req-5196dd08-e070-4bd2-9491-4a8c36d946de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.292523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460cad8da86145f684615b76699d3fe1', 'request_id': 'req-5196dd08-e070-4bd2-9491-4a8c36d946de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.292737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 889/1762] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:50 2022] DELETE /identity/v3/users/a7a56b2c69974d89b9bdb4ede549695a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:51.297493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.302979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:51.341956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] The token cache is being invalidate because project 460cad8da86145f684615b76699d3fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:51.342568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.345155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5196dd08-e070-4bd2-9491-4a8c36d946de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.363498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 874/1763] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:50 2022] DELETE /identity/v3/projects/460cad8da86145f684615b76699d3fe1 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:51.370618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222098-1705-4ddb-8a4e-972055f748bc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.371075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222098-1705-4ddb-8a4e-972055f748bc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.371516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae222098-1705-4ddb-8a4e-972055f748bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.418995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ae222098-1705-4ddb-8a4e-972055f748bc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:51.423137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ae222098-1705-4ddb-8a4e-972055f748bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:51.561764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469e3bf-0ec6-4a62-919b-ca90d110974c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.578011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.581070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.581549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.583336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] PATH_INFO: `/v3/users/e0d0dd99d47f48a5ba8c3613687ae897` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.588162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d0dd99d47f48a5ba8c3613687ae897)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.593564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.600486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 875/1764] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:51.604851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fb0b-deb5-4ff7-8f66-07e354cee98a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.605328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fb0b-deb5-4ff7-8f66-07e354cee98a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.605588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501fb0b-deb5-4ff7-8f66-07e354cee98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.648474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d501fb0b-deb5-4ff7-8f66-07e354cee98a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:51.653252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d501fb0b-deb5-4ff7-8f66-07e354cee98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:51.686191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 876/1765] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:51.686486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918cb11-4641-42c5-94b1-ccf5df389bec None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.686806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918cb11-4641-42c5-94b1-ccf5df389bec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.688102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918cb11-4641-42c5-94b1-ccf5df389bec None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.690590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 877/1766] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:41:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:41:51.692356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918cb11-4641-42c5-94b1-ccf5df389bec None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.717709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d0dd99d47f48a5ba8c3613687ae897'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.739012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d0dd99d47f48a5ba8c3613687ae897'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.747622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918cb11-4641-42c5-94b1-ccf5df389bec None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.752980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.753814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.754143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.754424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.755722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:51.756264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.758347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.787484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d0dd99d47f48a5ba8c3613687ae897'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.789383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d0dd99d47f48a5ba8c3613687ae897'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.795104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 878/1767] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:51.795318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f3bc68e0-a5c7-4453-ba8a-4f81604db5e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d0dd99d47f48a5ba8c3613687ae897'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:51.796764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.798715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:51.826370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4a46-c852-4635-bc44-0e6a2547a4e5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:51.831532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 890/1768] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:51 2022] DELETE /identity/v3/users/e0d0dd99d47f48a5ba8c3613687ae897 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:51.839274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9491e6-b52a-4a26-8b20-6ebea392b71c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.839698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:51.840342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:51.840647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.840917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.841264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9491e6-b52a-4a26-8b20-6ebea392b71c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:51.841569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:51.841677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9491e6-b52a-4a26-8b20-6ebea392b71c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:51.848651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:51.898126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2e9491e6-b52a-4a26-8b20-6ebea392b71c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:51.902318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2e9491e6-b52a-4a26-8b20-6ebea392b71c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:51.918123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 879/1769] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:51 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:41:51.919057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:51.960216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:52.061564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:52.084811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 891/1770] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:52.107916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036912e-292a-4fe7-b533-484fd1e17984 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:52.113992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.114996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.115394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.125842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:52.126860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.127172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.127482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.131260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:52.134583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:52.188242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:52.188242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:52.266123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 880/1771] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:51 2022] POST /identity/v3/users => generated 283 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:52.271404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:52.276997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:52.487131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 892/1772] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:41:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:41:52.489088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:52.518443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf662b-b4a1-4f38-a4be-9a8ad0862597 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:52.523514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34adb4b-9cbe-44fa-b8b5-15605681d89c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:52.524167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:52.524852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.525017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.525277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.526058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:52.527825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:52.541574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:52.542151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 893/1773] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:52.545648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.545930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.546207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.547053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:52.560459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be762934-17f8-4c6e-9f5b-0a8cffe14df6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:52.569607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45c065-7c91-49ec-a6ba-9d1169f3138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:52.571923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45c065-7c91-49ec-a6ba-9d1169f3138c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.573040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45c065-7c91-49ec-a6ba-9d1169f3138c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.573562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45c065-7c91-49ec-a6ba-9d1169f3138c admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.575654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45c065-7c91-49ec-a6ba-9d1169f3138c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:52.580065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45c065-7c91-49ec-a6ba-9d1169f3138c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:52.584843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:52.586415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:52.623452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 881/1774] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:52.639026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 894/1775] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:52.644207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:52.664069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552576cb-2d90-45e9-9997-c757b7fd729f service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:52.692449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:52.693676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.693676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.693676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] PATH_INFO: `/v3/projects/873972b3a93b445d9b5795a2b44fc65a/users/090d042926e346929310b519ec4dd284/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.753449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873972b3a93b445d9b5795a2b44fc65a, user_id=090d042926e346929310b519ec4dd284, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:52.757474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:52.799764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 882/1776] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:52 2022] PUT /identity/v3/projects/873972b3a93b445d9b5795a2b44fc65a/users/090d042926e346929310b519ec4dd284/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:52.811873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:52.812312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:52.812781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:52.938103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] MFA Rules not processed for user `090d042926e346929310b519ec4dd284`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:52.945910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:53.199053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.200796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:53.245058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 895/1777] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:53.258783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.372960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:53.382468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831912d6-5740-4fdf-9ffa-ed6a3aa2fbc9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:53.390051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:53.390701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.391199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.391727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.437765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:53.439529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:53.446043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab2e0e-6539-4db9-addc-ff70ffcde699 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:53.462088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:53.462904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.463314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.463681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.464449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:53.467238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 883/1778] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:53.468725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:53.525871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 896/1779] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:53 2022] POST /identity/v3/projects => generated 365 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:53.529892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.552692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119589bd-d89e-4500-b7ab-83af74594e33 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:53.639780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:53.680868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:53.688488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.688725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.688964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.689751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:53.692085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:53.747154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 884/1780] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:53 2022] POST /identity/v3/users => generated 289 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:53.747795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.766682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32902dd-f013-465c-9319-9196821a73f1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:53.778648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:53.779383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.779731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.782389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.783248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:53.786058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:53.815004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 897/1781] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:41:53.818006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.829396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edc27f-5c21-414b-89fe-5dc3b8865e0f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:53.840096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:53.841957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:53.842442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:53.842902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] PATH_INFO: `/v3/projects/90c674b1542444778b868f24b2708f86/users/eb8f34ae87bd4c25846418677d5d2054/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:53.882407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c674b1542444778b868f24b2708f86, user_id=eb8f34ae87bd4c25846418677d5d2054, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:53.888277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:53.914653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 885/1782] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:53 2022] PUT /identity/v3/projects/90c674b1542444778b868f24b2708f86/users/eb8f34ae87bd4c25846418677d5d2054/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:53.918603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:53.931792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89ab7-d1b1-4f2a-a7da-689d4166c3cf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.056876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f50a79-fac7-48a1-bf8d-27268d630245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.057640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f50a79-fac7-48a1-bf8d-27268d630245 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.057988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f50a79-fac7-48a1-bf8d-27268d630245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.058267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f50a79-fac7-48a1-bf8d-27268d630245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.059237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f50a79-fac7-48a1-bf8d-27268d630245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.061197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f50a79-fac7-48a1-bf8d-27268d630245 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.076282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 898/1783] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:54.082260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.118751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb627db-e3b8-4ad0-b056-9e322510e61c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.129955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.131583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.132117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.132807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] PATH_INFO: `/v3/projects/90c674b1542444778b868f24b2708f86/users/eb8f34ae87bd4c25846418677d5d2054/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.160751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90c674b1542444778b868f24b2708f86, user_id=eb8f34ae87bd4c25846418677d5d2054, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.163846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.209939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 886/1784] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:54 2022] PUT /identity/v3/projects/90c674b1542444778b868f24b2708f86/users/eb8f34ae87bd4c25846418677d5d2054/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:54.224064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.224414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.224630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.358102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] MFA Rules not processed for user `eb8f34ae87bd4c25846418677d5d2054`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:54.364633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:54.580221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.582141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:54.645614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 899/1785] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:54.654522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:54.658421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:54.715920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:54.764792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606837a8-65fd-43ec-ada4-3a26c549b3e0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.781057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.782807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.784017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.785527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] PATH_INFO: `/v3/projects/ee816b532f9b41ceb8ab0df80cd002f7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.789469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee816b532f9b41ceb8ab0df80cd002f7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.793482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.804613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45759019-1003-4fb9-9d8d-24a9ec9f4e18 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:54.814867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:54.815683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:54.816345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:54.816914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:54.857371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:54.861204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:54.898439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 900/1786] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:54.935111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee816b532f9b41ceb8ab0df80cd002f7', 'request_id': 'req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:54.953438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee816b532f9b41ceb8ab0df80cd002f7', 'request_id': 'req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:54.987772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee816b532f9b41ceb8ab0df80cd002f7', 'request_id': 'req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.041753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] The token cache is being invalidate because project ee816b532f9b41ceb8ab0df80cd002f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:55.042045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.043758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.051177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.052977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 887/1787] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:54 2022] DELETE /identity/v3/projects/ee816b532f9b41ceb8ab0df80cd002f7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:55.071663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333d5c5-6092-4d95-8377-3be6fdf7dd44 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.089220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.090799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:55.193311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:55.272827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.274616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.275673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.276019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] PATH_INFO: `/v3/users/b72c8b7e58bd4d1c9079c96fd0389452` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.279474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b72c8b7e58bd4d1c9079c96fd0389452)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.285647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.306091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240c8e7-3440-4b5a-a2fc-d1c031a0caf2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.321574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.322576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.323080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.338495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] PATH_INFO: `/v3/users/d3cbb2ac21b14840ad170624c9286834` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.345636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3cbb2ac21b14840ad170624c9286834)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.352551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.412789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b72c8b7e58bd4d1c9079c96fd0389452'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.425989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b72c8b7e58bd4d1c9079c96fd0389452'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.447172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b72c8b7e58bd4d1c9079c96fd0389452'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.448826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b72c8b7e58bd4d1c9079c96fd0389452'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.449884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b72c8b7e58bd4d1c9079c96fd0389452'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.477622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3cbb2ac21b14840ad170624c9286834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.484905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 901/1788] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:55 2022] DELETE /identity/v3/users/b72c8b7e58bd4d1c9079c96fd0389452 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:55.486405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.492630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:55.495212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3cbb2ac21b14840ad170624c9286834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.509971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3cbb2ac21b14840ad170624c9286834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.510578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3cbb2ac21b14840ad170624c9286834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.532479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5a13a08b-e70e-494e-beeb-fc3ff3c8acbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3cbb2ac21b14840ad170624c9286834'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:55.543837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 888/1789] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:55 2022] DELETE /identity/v3/users/d3cbb2ac21b14840ad170624c9286834 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:55.545324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.545636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.545912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.571565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:55.573121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:55.618580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:55.663768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376b4d-ffaa-4086-8f32-77a8bac0e9f9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:55.733401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 889/1790] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:55.747672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:55.748393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:55.748737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:55.749076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:55.751252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:55.885993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:55.887737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:55.903489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:55.921990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:55.949821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 902/1791] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:56.062166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:56.092225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923b6c-fb57-476d-80aa-4e90a04c2fdc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:56.102980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:56.103614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.103893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.104166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.122799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:56.124530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:56.164176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 890/1792] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:41:56.497809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:56.499264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.514422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:56.515945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.556443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b870374-b6ac-4c62-bbbc-74ead4fdd0a6 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:56.576557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f2737-ae39-40cf-adc6-4f92dbf202b5 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:56.580768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:56.583620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.584843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.585458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] PATH_INFO: `/v3/projects/2564587b811a4a0790edca7530ff3e4e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.588200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2564587b811a4a0790edca7530ff3e4e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:56.599340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:56.599537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:56.600296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.601308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.602678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] PATH_INFO: `/v3/projects/7e448e8f03974aa7b26c337c22c01653` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.607104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e448e8f03974aa7b26c337c22c01653)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:56.613677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:56.714476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e448e8f03974aa7b26c337c22c01653', 'request_id': 'req-0e7d3056-4389-4a89-b274-1f8594ef1049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.722939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e448e8f03974aa7b26c337c22c01653', 'request_id': 'req-0e7d3056-4389-4a89-b274-1f8594ef1049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.725692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2564587b811a4a0790edca7530ff3e4e', 'request_id': 'req-121e02a7-304a-4304-9295-3d443b787b8a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.729878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e448e8f03974aa7b26c337c22c01653', 'request_id': 'req-0e7d3056-4389-4a89-b274-1f8594ef1049'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.741441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2564587b811a4a0790edca7530ff3e4e', 'request_id': 'req-121e02a7-304a-4304-9295-3d443b787b8a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.745834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] The token cache is being invalidate because project 7e448e8f03974aa7b26c337c22c01653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:56.745834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.747054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0e7d3056-4389-4a89-b274-1f8594ef1049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.755349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2564587b811a4a0790edca7530ff3e4e', 'request_id': 'req-121e02a7-304a-4304-9295-3d443b787b8a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.756270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 891/1793] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:56 2022] DELETE /identity/v3/projects/7e448e8f03974aa7b26c337c22c01653 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:56.763100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.763527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.763805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.770150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] The token cache is being invalidate because project 2564587b811a4a0790edca7530ff3e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:56.770645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.771398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-121e02a7-304a-4304-9295-3d443b787b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.776576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 903/1794] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:56 2022] DELETE /identity/v3/projects/2564587b811a4a0790edca7530ff3e4e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:56.778072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b198fda-75b9-4471-8663-23933c48c92e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.778353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b198fda-75b9-4471-8663-23933c48c92e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.778626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b198fda-75b9-4471-8663-23933c48c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.790539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:56.792200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.800451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8b198fda-75b9-4471-8663-23933c48c92e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:56.801747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8b198fda-75b9-4471-8663-23933c48c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.842832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:56.882805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 892/1795] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:56.883807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:56.885066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.886934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 904/1796] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:56.894341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587833b-c1e9-49c0-9370-2361efc1e034 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.894625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587833b-c1e9-49c0-9370-2361efc1e034 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.894899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587833b-c1e9-49c0-9370-2361efc1e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.899219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce904bc3-a191-4e36-8a38-89c9c0df8eeb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:56.903934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:56.904572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.904852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.905123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] PATH_INFO: `/v3/projects/4ca321651eb44dbcbc87b1fc5359ca2d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.906384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca321651eb44dbcbc87b1fc5359ca2d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:56.908294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:56.914809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1587833b-c1e9-49c0-9370-2361efc1e034 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:56.916017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1587833b-c1e9-49c0-9370-2361efc1e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.924367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 905/1797] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:56.926145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:56.926433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:56.926704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:56.950135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:56.951362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:56.964091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca321651eb44dbcbc87b1fc5359ca2d', 'request_id': 'req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.972491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca321651eb44dbcbc87b1fc5359ca2d', 'request_id': 'req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.978035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:56.979422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca321651eb44dbcbc87b1fc5359ca2d', 'request_id': 'req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.993881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] The token cache is being invalidate because project 4ca321651eb44dbcbc87b1fc5359ca2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:56.994527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.994844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:56.996372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 893/1798] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:56 2022] DELETE /identity/v3/projects/4ca321651eb44dbcbc87b1fc5359ca2d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:56.997144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.000439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.018857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 906/1799] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:57.019779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.021478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.033047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb593ac-a10d-4aad-b7bc-24fea263ac51 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.037615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.038221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.038497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.038767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] PATH_INFO: `/v3/users/a49c84ba4b27431f827bdc9aa8a81f9f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.039873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49c84ba4b27431f827bdc9aa8a81f9f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.041813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.069857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222a5c9-f7e2-47f3-93d2-7a03ad605bf2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.075141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.075922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.076224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.076593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.077337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:57.077762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.079395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.093027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 894/1800] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:57.093989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49c84ba4b27431f827bdc9aa8a81f9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.094139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.104243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49c84ba4b27431f827bdc9aa8a81f9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.104713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca55c-e341-4d64-a8bc-a3f0791a398d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.110128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.110694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.110974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.111333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.112038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:57.112230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.114790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.119935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49c84ba4b27431f827bdc9aa8a81f9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.120753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49c84ba4b27431f827bdc9aa8a81f9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.121477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49c84ba4b27431f827bdc9aa8a81f9f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.130279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 895/1801] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:57.131188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.133031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.140605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 907/1802] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:41:57 2022] DELETE /identity/v3/users/a49c84ba4b27431f827bdc9aa8a81f9f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:57.141698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.145055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.163064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0461ba-a385-4d83-bce2-00a625d56ea3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.206451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:57.254941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a4275-7fab-494e-934e-b86cd20f5e01 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.265797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.266838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.267861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.268388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.269242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.271703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.279403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.280045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.280332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.280611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.281261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.287259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.350283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 908/1803] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:57.352491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 896/1804] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/projects => generated 401 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:57.353556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.354039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.459535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b269c-cc31-4faa-9be4-1e8092843e8c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.470043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:57.471974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.473499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.473942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.474259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.476596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.479602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.483391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f114da-50c4-4059-9e89-53b8844a2016 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.497260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.498152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.499029 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.499818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.501532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.504399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.516904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 909/1805] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:57.517961 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.521067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.538186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44bdbc-b3c3-443e-a50d-d92ad9df80fc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.553304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.554170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.554471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.554881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] PATH_INFO: `/v3/projects/735a2b40252b44d3b6c136d2d263c9a3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.556244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=735a2b40252b44d3b6c136d2d263c9a3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.558685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.560400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 897/1806] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:57.561313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.573317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962297f-e583-47dc-931c-216644ed4f51 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.592349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.593197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.593519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.593804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.594564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.599399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.623489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 898/1807] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:57.623489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.642486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe878830-8218-448f-9777-c7dc63da09bc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.642919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735a2b40252b44d3b6c136d2d263c9a3', 'request_id': 'req-adf0c744-368f-46a2-95ba-20f7a2354b7e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.651498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735a2b40252b44d3b6c136d2d263c9a3', 'request_id': 'req-adf0c744-368f-46a2-95ba-20f7a2354b7e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.664406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735a2b40252b44d3b6c136d2d263c9a3', 'request_id': 'req-adf0c744-368f-46a2-95ba-20f7a2354b7e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.682884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] The token cache is being invalidate because project 735a2b40252b44d3b6c136d2d263c9a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:41:57.683321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.684174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:41:57.688211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 910/1808] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:41:57 2022] DELETE /identity/v3/projects/735a2b40252b44d3b6c136d2d263c9a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:57.691704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.693822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.713593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9785d8-dc5e-4cf3-9748-aef859418fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.714288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9785d8-dc5e-4cf3-9748-aef859418fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.714545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9785d8-dc5e-4cf3-9748-aef859418fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.714887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9785d8-dc5e-4cf3-9748-aef859418fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.715546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9785d8-dc5e-4cf3-9748-aef859418fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.717824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9785d8-dc5e-4cf3-9748-aef859418fd1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.736497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 899/1809] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:57.738761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.739908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.740201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.762862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:57.764069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.775438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:57.780574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 900/1810] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:57.794001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.798293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.805789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0c744-368f-46a2-95ba-20f7a2354b7e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.814071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae68920-b7bd-4fb4-927a-8fb24b836b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.815414 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae68920-b7bd-4fb4-927a-8fb24b836b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.816694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae68920-b7bd-4fb4-927a-8fb24b836b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.818035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae68920-b7bd-4fb4-927a-8fb24b836b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.820150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae68920-b7bd-4fb4-927a-8fb24b836b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.821897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae68920-b7bd-4fb4-927a-8fb24b836b9d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.824722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecb9f5-ad1d-4680-93d0-f83084ff9eec None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.831021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.831870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.832182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.833137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.834206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.838827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.838967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 911/1811] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:57.838967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.838967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.838967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.856304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 901/1812] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:57.857740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.859123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:57.861122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:57.870079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc6581-6cf2-430e-b7bf-9160703628da admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.870944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 912/1813] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:57.873615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.878287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.879619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.879911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.880199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] PATH_INFO: `/v3/projects/60d973b4c83e47918cf2f570375b948b/users/4140708bdf764a2292ec06ccadef7e29/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.883545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79940ea3-5663-4941-814b-6599e3e17794 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:57.888638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9db560-c813-4c73-b93b-69254aad86e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:57.889307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db560-c813-4c73-b93b-69254aad86e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.889647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db560-c813-4c73-b93b-69254aad86e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.889922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9db560-c813-4c73-b93b-69254aad86e9 admin admin] PATH_INFO: `/v3/projects/bc85622c83f4455bb35dd3a049b3e79c/users/5d1558dd01784c8f9e8e3629afccc97c/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.898091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d973b4c83e47918cf2f570375b948b, user_id=4140708bdf764a2292ec06ccadef7e29, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.900746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.905272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9db560-c813-4c73-b93b-69254aad86e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc85622c83f4455bb35dd3a049b3e79c, user_id=5d1558dd01784c8f9e8e3629afccc97c, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:57.907929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9db560-c813-4c73-b93b-69254aad86e9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:57.920407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 902/1814] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:57 2022] PUT /identity/v3/projects/60d973b4c83e47918cf2f570375b948b/users/4140708bdf764a2292ec06ccadef7e29/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:57.922332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:57.923007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 913/1815] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:57 2022] PUT /identity/v3/projects/bc85622c83f4455bb35dd3a049b3e79c/users/5d1558dd01784c8f9e8e3629afccc97c/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:57.937505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6e41-533d-4ee3-bc92-c1ffb61d51e4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:57.938277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6e41-533d-4ee3-bc92-c1ffb61d51e4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:57.938554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6e41-533d-4ee3-bc92-c1ffb61d51e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:57.972919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-55aa6e41-533d-4ee3-bc92-c1ffb61d51e4 None None] MFA Rules not processed for user `4140708bdf764a2292ec06ccadef7e29`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:57.974823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-55aa6e41-533d-4ee3-bc92-c1ffb61d51e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:58.009603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878d1e6-e011-4ad1-bc71-ce9232df3549 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.051598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 914/1816] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:57 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:58.051598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.051874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.052091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.061713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.082806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] MFA Rules not processed for user `5d1558dd01784c8f9e8e3629afccc97c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:58.084423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:58.089802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.090422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.090704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.090969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.091626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:41:58.091946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.093628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.106328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 903/1817] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:41:58.107138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.117630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06d76ce-7333-4bf9-9734-b366514c2c8d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.122252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.122845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.123183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.123387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.124023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.126022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.154316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 915/1818] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:58.155045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.166258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea056e9c-234f-4aed-901f-b66f1cf84d5e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.166998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 904/1819] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/projects => generated 401 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:58.167815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.195651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.231582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.232316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.232482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.232759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.233548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.235019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc87c0e-89e7-40fe-9d0a-d29540b261a9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.235488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.240776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.241431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.241711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.241981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.242615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.244511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.264333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 916/1820] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:58.265141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.276164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 905/1821] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:58.277645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.330306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be944a81-0771-4828-8f6b-2538394105d4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.346893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39254e75-b58c-4959-a92e-64db83e722cf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.352535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.353164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.354373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.354651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.355282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.357561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.383764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 906/1822] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:58.384751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.395507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478fa42-4449-4771-ade7-3f3b60ee11c9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.399573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.400276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.400448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.400667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.401009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.401255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.401629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.401885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.402031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.402722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.403935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.406610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.431097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 917/1823] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/users => generated 307 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:58.432044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.443366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 907/1824] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/users => generated 294 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:58.444140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b398ac-f2ad-478e-989d-9d6fa2aedfef admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.447314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.451174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.451174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.451567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.451915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.452927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.455877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.458541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8d817-fbae-4051-91ce-4988d7516e6a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.463597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.464183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.464464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.464747 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.465430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.467034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.468814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.475819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 918/1825] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:58.479280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.486200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 908/1826] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:58.487152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.494806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08a6e8-022e-400d-915f-d445bff4c720 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.497913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3702b1d5-03c6-44e5-96bd-2e69e434901f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.501981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.502927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.503278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.503654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.504275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.504451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.505231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.505736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.506187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.506574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.507541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.509621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.525024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 919/1827] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:58.525024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.526946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 909/1828] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:58.528353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.543757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e37672-0192-4917-92e2-2f430d76e3b8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.546452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc8b3e-49cd-4456-892e-4c6eba6f88ef admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.548769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.549561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.549912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.550283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] PATH_INFO: `/v3/projects/d96f08913a4443ebb381dcb563394cc0/users/9695cf1161ba4acf9ee150bbd074a1ed/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.551765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.552753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.553116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.554165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] PATH_INFO: `/v3/projects/2d779e1a9fcd4f979a804ec002126052/users/0365647f6f76402ea872c1fd8af25e74/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.568036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96f08913a4443ebb381dcb563394cc0, user_id=9695cf1161ba4acf9ee150bbd074a1ed, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.571161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.571525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d779e1a9fcd4f979a804ec002126052, user_id=0365647f6f76402ea872c1fd8af25e74, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.574316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.589288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 910/1829] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:58 2022] PUT /identity/v3/projects/d96f08913a4443ebb381dcb563394cc0/users/9695cf1161ba4acf9ee150bbd074a1ed/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:58.592899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.593632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 920/1830] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:58 2022] PUT /identity/v3/projects/2d779e1a9fcd4f979a804ec002126052/users/0365647f6f76402ea872c1fd8af25e74/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:58.594574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.599744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:58.671033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8ec3f-c006-4c5d-8744-58ee8aa07178 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.708437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800d6c6-ae67-4f9b-b912-ddc3629dd21f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.714172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.714843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.715309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.715995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.716864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.718768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.731388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 921/1831] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:58.733049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.744504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.745249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.745562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.745927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] PATH_INFO: `/v3/projects/070a7e4dc397497fa9a4da3812ead041/users/3d57cfd89a654d23be4312a5296ed712/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.748929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66811a-d181-49b9-ad9f-788b39a9a32f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.754792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.756307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.756986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.757501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.758257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.760618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.763811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070a7e4dc397497fa9a4da3812ead041, user_id=3d57cfd89a654d23be4312a5296ed712, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.766862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.775279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 922/1832] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:58.776337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.807671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 911/1833] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:58 2022] PUT /identity/v3/projects/070a7e4dc397497fa9a4da3812ead041/users/3d57cfd89a654d23be4312a5296ed712/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:58.807671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:58.808163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61470201-8036-427b-b413-0d0aecee96c2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:58.889107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4972d6-3fb1-40b0-b9c3-402b4cc3da2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:58.889836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4972d6-3fb1-40b0-b9c3-402b4cc3da2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.890579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4972d6-3fb1-40b0-b9c3-402b4cc3da2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.891167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4972d6-3fb1-40b0-b9c3-402b4cc3da2e admin admin] PATH_INFO: `/v3/projects/d96f08913a4443ebb381dcb563394cc0/users/9695cf1161ba4acf9ee150bbd074a1ed/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.894140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4972d6-3fb1-40b0-b9c3-402b4cc3da2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96f08913a4443ebb381dcb563394cc0, user_id=9695cf1161ba4acf9ee150bbd074a1ed, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:58.897268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4972d6-3fb1-40b0-b9c3-402b4cc3da2e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:58.939213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 923/1834] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:58 2022] PUT /identity/v3/projects/d96f08913a4443ebb381dcb563394cc0/users/9695cf1161ba4acf9ee150bbd074a1ed/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:58.939213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9b69-379f-4945-97a4-9e8c1a4b06b0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:58.939213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9b69-379f-4945-97a4-9e8c1a4b06b0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:58.939213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d9b69-379f-4945-97a4-9e8c1a4b06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:58.974616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-af2d9b69-379f-4945-97a4-9e8c1a4b06b0 None None] MFA Rules not processed for user `3d57cfd89a654d23be4312a5296ed712`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:58.974616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-af2d9b69-379f-4945-97a4-9e8c1a4b06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:58.984301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.013898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787115e-327c-4101-a903-9fbed2dc8912 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.075334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 924/1835] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:59.076687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff41b6-424a-437f-8b57-2f445133ae61 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.076974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff41b6-424a-437f-8b57-2f445133ae61 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.077249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff41b6-424a-437f-8b57-2f445133ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.124516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.125193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.125504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.125781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] PATH_INFO: `/v3/projects/2d779e1a9fcd4f979a804ec002126052/users/0365647f6f76402ea872c1fd8af25e74/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.127728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d779e1a9fcd4f979a804ec002126052, user_id=0365647f6f76402ea872c1fd8af25e74, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.130858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.134258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.151798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 912/1836] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:58 2022] PUT /identity/v3/projects/2d779e1a9fcd4f979a804ec002126052/users/0365647f6f76402ea872c1fd8af25e74/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:41:59.153687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.166134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-acff41b6-424a-437f-8b57-2f445133ae61 None None] MFA Rules not processed for user `9695cf1161ba4acf9ee150bbd074a1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:59.168146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-acff41b6-424a-437f-8b57-2f445133ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:59.258258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9bb10-fecc-4aa2-ac78-a0efc82dd521 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.269801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.270672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.270792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 925/1837] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:59.270881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.270954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.272567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.276793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.276793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.277248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.283933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.314583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] MFA Rules not processed for user `0365647f6f76402ea872c1fd8af25e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:41:59.315928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:59.327371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 913/1838] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:41:59 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:59.330529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.332902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:59.404936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739b7c0-ee57-48f5-8900-d56dbdeea5cd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.409094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.410473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.410863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.411016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.417315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 926/1839] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:41:59.417315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.426845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e60637-4665-48b9-b42e-383a290b7e00 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.475640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.517085 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.517951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.521008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.521293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.522237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.524936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.539090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.541036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.556315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 914/1840] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:59.572709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 927/1841] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:41:59 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:41:59.576240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.587036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.593333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:41:59.595585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a3d08-27df-4c5e-8fa4-1b0aa1bf6ef2 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.610680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.613286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.613820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.615058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.615729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.619120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.622057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f91183-014e-419c-9b26-e71fa7fc52b2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.626630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.627382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.629504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.630486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.643240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:41:59.656268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 915/1842] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:59.657841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.678886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20efbf3-8234-4069-8120-7ab85390d94f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.686866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.687962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.688695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.690224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] PATH_INFO: `/v3/projects/20fd3b7ef8474e8aaa329d4ab9263009/users/2b8d8f64e26343d4ad0ede906a5bb065/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.719834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fd3b7ef8474e8aaa329d4ab9263009, user_id=2b8d8f64e26343d4ad0ede906a5bb065, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.727634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.754783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 916/1843] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:59 2022] PUT /identity/v3/projects/20fd3b7ef8474e8aaa329d4ab9263009/users/2b8d8f64e26343d4ad0ede906a5bb065/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:59.758287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.761733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.763193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.788962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 928/1844] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:41:59.897038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654fda9-ed2d-4da7-9b9c-c041132c6902 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.902981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212d50-04fe-4813-8c82-3e9bbabe5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.903690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212d50-04fe-4813-8c82-3e9bbabe5b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.904038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212d50-04fe-4813-8c82-3e9bbabe5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.904428 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212d50-04fe-4813-8c82-3e9bbabe5b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.905297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212d50-04fe-4813-8c82-3e9bbabe5b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.907272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212d50-04fe-4813-8c82-3e9bbabe5b00 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.929399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 917/1845] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:41:59.931918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:41:59.945889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de3967-6aed-4228-891a-e1889f79ad17 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:41:59.952638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:41:59.953397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.953624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.953976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] PATH_INFO: `/v3/projects/20fd3b7ef8474e8aaa329d4ab9263009/users/2b8d8f64e26343d4ad0ede906a5bb065/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:41:59.956433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20fd3b7ef8474e8aaa329d4ab9263009, user_id=2b8d8f64e26343d4ad0ede906a5bb065, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:41:59.960038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:41:59.980193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 929/1846] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:41:59 2022] PUT /identity/v3/projects/20fd3b7ef8474e8aaa329d4ab9263009/users/2b8d8f64e26343d4ad0ede906a5bb065/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:41:59.991946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:41:59.992242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:41:59.992544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:00.038600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] MFA Rules not processed for user `2b8d8f64e26343d4ad0ede906a5bb065`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:00.042547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:00.153485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:00.197703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 918/1847] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:41:59 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:00.221653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:00.248204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229d5f6-070f-492d-b2c2-fe0d90e49447 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:00.252245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:00.253067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:00.254214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:00.254601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:00.260981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:00.294507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29ee92-428c-415a-b382-ced20bdbc0d9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:00.299012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:00.299631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:00.299911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:00.302117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:00.316999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:00.318310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:00.327557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:00.329240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:00.330529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 919/1848] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:00.343017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 930/1849] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:00 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:01.037124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:01.049693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f61e52-fa63-4d21-8586-b7547bd2c968 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:01.055038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8ac5a-e28e-44f1-b473-58a903a4a5ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:01.056050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8ac5a-e28e-44f1-b473-58a903a4a5ec service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:01.056508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8ac5a-e28e-44f1-b473-58a903a4a5ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:01.056802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8ac5a-e28e-44f1-b473-58a903a4a5ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:01.153617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8ac5a-e28e-44f1-b473-58a903a4a5ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:01.155610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8ac5a-e28e-44f1-b473-58a903a4a5ec service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:01.181203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 920/1850] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:01.219118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:01.229273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f3ac-f261-4106-b24b-951e5f9c3b22 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:01.233545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9700ef-7d82-4b9a-8af6-e43b9aedec2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:01.234156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9700ef-7d82-4b9a-8af6-e43b9aedec2d service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:01.234433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9700ef-7d82-4b9a-8af6-e43b9aedec2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:01.234708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9700ef-7d82-4b9a-8af6-e43b9aedec2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:01.318534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:01.379662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9700ef-7d82-4b9a-8af6-e43b9aedec2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:01.382070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9700ef-7d82-4b9a-8af6-e43b9aedec2d service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:01.403746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 931/1851] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:03.021653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c21de6-4cb9-4278-add5-8773b7061403 None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:03.022148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c21de6-4cb9-4278-add5-8773b7061403 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:03.022253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c21de6-4cb9-4278-add5-8773b7061403 None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:03.024502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 921/1852] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:42:03.043698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:03.044289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:03.044506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:03.100963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:03.102689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:03.226114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 932/1853] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:42:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:03.324202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c21de6-4cb9-4278-add5-8773b7061403 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:03.326736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c0c21de6-4cb9-4278-add5-8773b7061403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:03.358660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c21de6-4cb9-4278-add5-8773b7061403 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:03.371142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9553a-9638-4d73-ae40-337506211a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:03.371781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9553a-9638-4d73-ae40-337506211a5b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:03.372063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9553a-9638-4d73-ae40-337506211a5b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:03.372933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9553a-9638-4d73-ae40-337506211a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:03.389879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9553a-9638-4d73-ae40-337506211a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:03.392042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9553a-9638-4d73-ae40-337506211a5b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:03.406187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 922/1854] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:03.813769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:03.816020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:03.897625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a708d-1b31-460c-b6d4-6e92aa917df9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:03.904562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:03.905316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:03.905671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:03.906000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] PATH_INFO: `/v3/users/090d042926e346929310b519ec4dd284` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:03.907640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090d042926e346929310b519ec4dd284)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:03.910221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:03.966322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090d042926e346929310b519ec4dd284'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:03.975847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090d042926e346929310b519ec4dd284'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:03.991283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090d042926e346929310b519ec4dd284'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:03.992091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090d042926e346929310b519ec4dd284'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:03.992912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090d042926e346929310b519ec4dd284'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:03.995426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:04.009635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 933/1855] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:03 2022] DELETE /identity/v3/users/090d042926e346929310b519ec4dd284 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:04.014544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.014870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.015166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.054446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:04.055842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.138372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 923/1856] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:04.153168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:04.156055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.189794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:04.192120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.207051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc02ef4-8526-4c07-a667-e335c09906eb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:04.213446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:04.214440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.214947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.215382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] PATH_INFO: `/v3/users/3d57cfd89a654d23be4312a5296ed712` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.217862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d57cfd89a654d23be4312a5296ed712)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:04.220815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:04.248017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d45dd-f8db-4f25-9183-5c3a775b01b3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:04.252857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0a78d-5240-4e33-8d87-bb829788bc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:04.255011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a78d-5240-4e33-8d87-bb829788bc4f service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.255374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a78d-5240-4e33-8d87-bb829788bc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.255688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0a78d-5240-4e33-8d87-bb829788bc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.266672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0a78d-5240-4e33-8d87-bb829788bc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:04.267992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0a78d-5240-4e33-8d87-bb829788bc4f service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:04.278802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 934/1857] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:04.280552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:04.287093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d57cfd89a654d23be4312a5296ed712'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:04.296561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d57cfd89a654d23be4312a5296ed712'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:04.306327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d57cfd89a654d23be4312a5296ed712'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:04.307106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d57cfd89a654d23be4312a5296ed712'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:04.332354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d57cfd89a654d23be4312a5296ed712'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:04.342198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 924/1858] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:04 2022] DELETE /identity/v3/users/3d57cfd89a654d23be4312a5296ed712 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:04.346888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.347382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.347880 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.372201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:04.373495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.438376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 935/1859] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:04.452445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:04.454263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.531398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef3ca7-aa06-48b5-8c72-53258d1ffdf9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:04.537332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:04.537977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.538258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.538527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.548653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:04.550990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:04.562459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 925/1860] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:04.872154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:04.873734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:04.888194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8cba0-e6c4-4758-9185-52e58abbfa7f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:04.896646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:04.897729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:04.898109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:04.898375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] PATH_INFO: `/v3/projects/873972b3a93b445d9b5795a2b44fc65a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:04.899821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873972b3a93b445d9b5795a2b44fc65a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:04.903524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:04.997673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873972b3a93b445d9b5795a2b44fc65a', 'request_id': 'req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.009198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873972b3a93b445d9b5795a2b44fc65a', 'request_id': 'req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.029554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873972b3a93b445d9b5795a2b44fc65a', 'request_id': 'req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.043255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:05.043602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] The token cache is being invalidate because project 873972b3a93b445d9b5795a2b44fc65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:05.043907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.044583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.045187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.046549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 936/1861] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:04 2022] DELETE /identity/v3/projects/873972b3a93b445d9b5795a2b44fc65a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:05.051719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:05.053239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.071405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a1316-063d-4c86-ae63-e5a60bf7d0df service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:05.075367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:05.144865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af66782-cd46-4f19-a2b2-d1d0ba9d8963 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:05.152285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:05.153857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.154426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.154426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] PATH_INFO: `/v3/users/eb8f34ae87bd4c25846418677d5d2054` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.155986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb8f34ae87bd4c25846418677d5d2054)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:05.159022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:05.189462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:05.190491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.191172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.191707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] PATH_INFO: `/v3/users/4140708bdf764a2292ec06ccadef7e29` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.193701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4140708bdf764a2292ec06ccadef7e29)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:05.197447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:05.246757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb8f34ae87bd4c25846418677d5d2054'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.268456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb8f34ae87bd4c25846418677d5d2054'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.283867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb8f34ae87bd4c25846418677d5d2054'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.288455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb8f34ae87bd4c25846418677d5d2054'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.289505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb8f34ae87bd4c25846418677d5d2054'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.313257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4140708bdf764a2292ec06ccadef7e29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.313911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 937/1862] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:05 2022] DELETE /identity/v3/users/eb8f34ae87bd4c25846418677d5d2054 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:05.314851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:05.323403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.335438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4140708bdf764a2292ec06ccadef7e29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.354849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4140708bdf764a2292ec06ccadef7e29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.355894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4140708bdf764a2292ec06ccadef7e29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.357678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:05.382848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-47f9049e-1276-4461-845b-cbcd9cf243e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4140708bdf764a2292ec06ccadef7e29'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.397512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 926/1863] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:05 2022] DELETE /identity/v3/users/4140708bdf764a2292ec06ccadef7e29 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:05.402313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.402703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.403077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.441289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:05.442696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.446228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df9eb0-b49a-4783-98e7-6e059d1cfc98 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:05.522300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:05.561340 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:05.562435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.562973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.563352 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] PATH_INFO: `/v3/projects/070a7e4dc397497fa9a4da3812ead041` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.564185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 927/1864] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:05.564970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=070a7e4dc397497fa9a4da3812ead041)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:05.576284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:05.577909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:05.580866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.656370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070a7e4dc397497fa9a4da3812ead041', 'request_id': 'req-a2d6d2a9-218a-4137-8c63-44993174ee25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.670434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070a7e4dc397497fa9a4da3812ead041', 'request_id': 'req-a2d6d2a9-218a-4137-8c63-44993174ee25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.679327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070a7e4dc397497fa9a4da3812ead041', 'request_id': 'req-a2d6d2a9-218a-4137-8c63-44993174ee25'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.700801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] The token cache is being invalidate because project 070a7e4dc397497fa9a4da3812ead041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:05.701476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.702432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.704912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 938/1865] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:05 2022] DELETE /identity/v3/projects/070a7e4dc397497fa9a4da3812ead041 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:05.709539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:05.711121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.756118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26fe6a-d1eb-46f1-973c-7a08e271ea5e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:05.880696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6d2a9-218a-4137-8c63-44993174ee25 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:05.889078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:05.890129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.890577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.891225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] PATH_INFO: `/v3/users/2b8d8f64e26343d4ad0ede906a5bb065` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.892617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8d8f64e26343d4ad0ede906a5bb065)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:05.895082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:05.918272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:05.918998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:05.919220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:05.919590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:05.921839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:05.951490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:05.953211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:05.984803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 928/1866] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:05.992704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8d8f64e26343d4ad0ede906a5bb065'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:05.998210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.004991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.005484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8d8f64e26343d4ad0ede906a5bb065'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.025226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8d8f64e26343d4ad0ede906a5bb065'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.026230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8d8f64e26343d4ad0ede906a5bb065'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.027647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8d8f64e26343d4ad0ede906a5bb065'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.028677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20119e-17a9-4229-8966-bb5b01d63827 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:06.031976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:06.045738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:06.046582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.047129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.047402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] PATH_INFO: `/v3/projects/90c674b1542444778b868f24b2708f86` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.050678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90c674b1542444778b868f24b2708f86)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:06.052635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:06.056415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 939/1867] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:05 2022] DELETE /identity/v3/users/2b8d8f64e26343d4ad0ede906a5bb065 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:06.058131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.060322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.125811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:06.156591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c674b1542444778b868f24b2708f86', 'request_id': 'req-afe26887-959e-402a-b221-84d296dcf3e5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.177599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c674b1542444778b868f24b2708f86', 'request_id': 'req-afe26887-959e-402a-b221-84d296dcf3e5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.178803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0618e-65a7-4956-b0fe-c80d25d11e68 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:06.186971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c674b1542444778b868f24b2708f86', 'request_id': 'req-afe26887-959e-402a-b221-84d296dcf3e5'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.203479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] The token cache is being invalidate because project 90c674b1542444778b868f24b2708f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:06.204228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.205141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-afe26887-959e-402a-b221-84d296dcf3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.208385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 929/1868] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:05 2022] DELETE /identity/v3/projects/90c674b1542444778b868f24b2708f86 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:06.213251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652fe5-acbe-440f-87f2-516b45d4bc48 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.213576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652fe5-acbe-440f-87f2-516b45d4bc48 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.213856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13652fe5-acbe-440f-87f2-516b45d4bc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.245108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-13652fe5-acbe-440f-87f2-516b45d4bc48 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:06.246655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-13652fe5-acbe-440f-87f2-516b45d4bc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.338324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:06.340996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.341602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.343253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] PATH_INFO: `/v3/users/5d1558dd01784c8f9e8e3629afccc97c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.346138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1558dd01784c8f9e8e3629afccc97c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:06.353290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:06.427097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 930/1869] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:06.435052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.435381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.435680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.455668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1558dd01784c8f9e8e3629afccc97c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.467316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1558dd01784c8f9e8e3629afccc97c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.487230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1558dd01784c8f9e8e3629afccc97c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.488056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1558dd01784c8f9e8e3629afccc97c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.488890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-5314697f-fbbb-4714-8ec9-aaec08042b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1558dd01784c8f9e8e3629afccc97c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.494618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:06.496063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.514639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 931/1870] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:06.516789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.519552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 940/1871] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:06 2022] DELETE /identity/v3/users/5d1558dd01784c8f9e8e3629afccc97c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:06.524598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.524988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.525198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.542887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c6d19-4b8f-4cee-baed-dbd6f4a7c6fc None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:06.566010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:06.567265 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.588651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:06.660675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:06.661577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.661779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.662106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.662913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:06.663272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:06.665449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:06.685449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 941/1872] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:06.685449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.685449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.702409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 932/1873] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:06.704071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6976ce5-61a0-4480-95b3-f88fd3577333 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:06.705227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.711945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:06.712678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.712899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.713174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] PATH_INFO: `/v3/projects/60d973b4c83e47918cf2f570375b948b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.714550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d973b4c83e47918cf2f570375b948b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:06.716472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:06.725534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315dba-7202-4319-bc3b-5dfe1106dec6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:06.754274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:06.757297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.757919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.758213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.758889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:06.765682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:06.786623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d973b4c83e47918cf2f570375b948b', 'request_id': 'req-94d39eff-8228-4066-b902-d40f73e84a6b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.799159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d973b4c83e47918cf2f570375b948b', 'request_id': 'req-94d39eff-8228-4066-b902-d40f73e84a6b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.812434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d973b4c83e47918cf2f570375b948b', 'request_id': 'req-94d39eff-8228-4066-b902-d40f73e84a6b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.833289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 933/1874] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:06 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:06.833289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.834813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] The token cache is being invalidate because project 60d973b4c83e47918cf2f570375b948b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:06.834813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.834813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:06.838446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 942/1875] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:06 2022] DELETE /identity/v3/projects/60d973b4c83e47918cf2f570375b948b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:06.842278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.842476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:06.844513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.888370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:06.926594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f182bfae-1588-4d66-958a-eafe35053c4e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:06.931454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:06.932120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:06.932283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:06.932546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:06.934625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:06.943326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d39eff-8228-4066-b902-d40f73e84a6b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.014874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.016408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:07.016575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.030783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 934/1876] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:07.031734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.031877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.032917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.033306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.033745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] PATH_INFO: `/v3/projects/20fd3b7ef8474e8aaa329d4ab9263009` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.036071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=20fd3b7ef8474e8aaa329d4ab9263009)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.036199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.037878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.055118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7ff6a-5309-4ebe-b763-e300a6e052f9 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.060838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.061641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.061923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.062198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.062843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.065079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.094058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 935/1877] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/users => generated 294 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:07.095280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.097066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.099046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20fd3b7ef8474e8aaa329d4ab9263009', 'request_id': 'req-eb3444df-256d-4dae-9d60-a2b7851989cd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.108814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20fd3b7ef8474e8aaa329d4ab9263009', 'request_id': 'req-eb3444df-256d-4dae-9d60-a2b7851989cd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.114074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f569ce2-377f-4ed5-863f-a0ec8b873516 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.120294 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20fd3b7ef8474e8aaa329d4ab9263009', 'request_id': 'req-eb3444df-256d-4dae-9d60-a2b7851989cd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.140489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] The token cache is being invalidate because project 20fd3b7ef8474e8aaa329d4ab9263009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:07.140930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.142151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.147461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 943/1878] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:06 2022] DELETE /identity/v3/projects/20fd3b7ef8474e8aaa329d4ab9263009 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:07.149087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.151322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.220179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.220826 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.221104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.222462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] PATH_INFO: `/v3/users/0365647f6f76402ea872c1fd8af25e74` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.224545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0365647f6f76402ea872c1fd8af25e74)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.226138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.276834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3444df-256d-4dae-9d60-a2b7851989cd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.282291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b63fd-7d34-4c87-85fd-c840daf687b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.283208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b63fd-7d34-4c87-85fd-c840daf687b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.283591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b63fd-7d34-4c87-85fd-c840daf687b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.284130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b63fd-7d34-4c87-85fd-c840daf687b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.285066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b63fd-7d34-4c87-85fd-c840daf687b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.287782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b63fd-7d34-4c87-85fd-c840daf687b7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.303241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0365647f6f76402ea872c1fd8af25e74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.315332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0365647f6f76402ea872c1fd8af25e74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.319134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 944/1879] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:07.320987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.322631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.322631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.337196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0365647f6f76402ea872c1fd8af25e74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.337991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0365647f6f76402ea872c1fd8af25e74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.340797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:07.352995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:07.354540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.365919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-28e6d6ad-06b6-494b-8aef-2c07b24ad19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0365647f6f76402ea872c1fd8af25e74'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.367444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 945/1880] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:07.374501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 936/1881] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:07 2022] DELETE /identity/v3/users/0365647f6f76402ea872c1fd8af25e74 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:07.376460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.378659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.379878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.380382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.380769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.398633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45808060-4a8e-47ac-b580-580eeaf201de None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.413864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:07.414773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.487051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.488671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.489330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.489884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.491014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.493295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.511520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 946/1882] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:07.517073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.521212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.543729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7f7d6-4d8a-4fa8-b697-2f391999abb6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.553074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.554036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.555281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.555773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] PATH_INFO: `/v3/projects/bc85622c83f4455bb35dd3a049b3e79c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.558651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc85622c83f4455bb35dd3a049b3e79c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.574415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.583687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:07.587395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 937/1883] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:07.588689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.602463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d68559-86bc-45ad-8708-b0e41dfe3ac2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.613697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.614423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.617689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.618145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] PATH_INFO: `/v3/projects/156c6b533baf460092b7895ba8b04486/users/cb3e26e61ecf4ec89f288ee5be69993e/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.639644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=156c6b533baf460092b7895ba8b04486, user_id=cb3e26e61ecf4ec89f288ee5be69993e, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.643178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.655557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc85622c83f4455bb35dd3a049b3e79c', 'request_id': 'req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.672013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 938/1884] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:07 2022] PUT /identity/v3/projects/156c6b533baf460092b7895ba8b04486/users/cb3e26e61ecf4ec89f288ee5be69993e/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:07.673730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.678624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc85622c83f4455bb35dd3a049b3e79c', 'request_id': 'req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.692113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc85622c83f4455bb35dd3a049b3e79c', 'request_id': 'req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.710163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] The token cache is being invalidate because project bc85622c83f4455bb35dd3a049b3e79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:07.710570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.711367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e691bba4-3bf3-45c6-bd5a-43fa4b92333a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.713179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 947/1885] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:07 2022] DELETE /identity/v3/projects/bc85622c83f4455bb35dd3a049b3e79c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:07.718527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.718527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.718527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.755225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] MFA Rules not processed for user `cb3e26e61ecf4ec89f288ee5be69993e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:07.756397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.763990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a171226-d702-470e-af14-261e44c74c98 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.770607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.771267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.771542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.771864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.772519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:07.772864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.775324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.800723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 939/1886] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:07.800723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.800723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.837836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b0275-cad7-4dc9-b143-9e29a7f8012f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.845064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.846051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.846538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.847045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] PATH_INFO: `/v3/users/9695cf1161ba4acf9ee150bbd074a1ed` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.848696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9695cf1161ba4acf9ee150bbd074a1ed)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.863660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.869367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 948/1887] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:07.869367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.869367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.901431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82dc362-e423-4173-b228-6fa921fac94a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:07.907653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:07.908394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:07.908677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:07.908948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:07.909870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:07.911804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:07.957534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:07.959872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9695cf1161ba4acf9ee150bbd074a1ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.971262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 949/1888] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:07.972491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9695cf1161ba4acf9ee150bbd074a1ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.972969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:07.981261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:07.994465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9695cf1161ba4acf9ee150bbd074a1ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:07.996189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9695cf1161ba4acf9ee150bbd074a1ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.022709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9695cf1161ba4acf9ee150bbd074a1ed'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.030763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 940/1889] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:07 2022] DELETE /identity/v3/users/9695cf1161ba4acf9ee150bbd074a1ed => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:08.031773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.034226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:08.085668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:08.093521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fa0b9-a22b-400e-a9e4-7e589c0b23b4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.240694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.241750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.242228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.242689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.243728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.246848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.283745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2838f-4e9d-4a9f-9d4d-5e7b9bcd707d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.290647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.291488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.291998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.292560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] PATH_INFO: `/v3/projects/2d779e1a9fcd4f979a804ec002126052` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.295215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d779e1a9fcd4f979a804ec002126052)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.297586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.322704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 950/1890] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:07 2022] POST /identity/v3/projects => generated 385 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:08.322704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.325503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:08.383312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d779e1a9fcd4f979a804ec002126052', 'request_id': 'req-9cb7dd01-18ac-49f4-a43b-377f934c45a3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.400736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d779e1a9fcd4f979a804ec002126052', 'request_id': 'req-9cb7dd01-18ac-49f4-a43b-377f934c45a3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.416268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d779e1a9fcd4f979a804ec002126052', 'request_id': 'req-9cb7dd01-18ac-49f4-a43b-377f934c45a3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.453195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] The token cache is being invalidate because project 2d779e1a9fcd4f979a804ec002126052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:08.453368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.454484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:08.458108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 941/1891] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:08 2022] DELETE /identity/v3/projects/2d779e1a9fcd4f979a804ec002126052 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:08.460188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.464169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:08.505829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8028139-f8f8-4d2a-8b4b-ad7fc45ad21b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.571832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:08.595210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7dd01-18ac-49f4-a43b-377f934c45a3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.609775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cd53f-a7f8-4d79-9fa6-549e3db5cbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.612464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd53f-a7f8-4d79-9fa6-549e3db5cbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.612836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd53f-a7f8-4d79-9fa6-549e3db5cbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.613224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cd53f-a7f8-4d79-9fa6-549e3db5cbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.614272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd53f-a7f8-4d79-9fa6-549e3db5cbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.617738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cd53f-a7f8-4d79-9fa6-549e3db5cbb5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.656573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 942/1892] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:08 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:08.656573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.656573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.656573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.663354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.664811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.666016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.666016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.666778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.670035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.680886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:08.682173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:08.693153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 943/1893] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:08.694125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.698870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 951/1894] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:08 2022] POST /identity/v3/users => generated 290 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:08.700353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.702441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:08.705137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280c6bd-9d6f-4430-9873-e733603baae3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.712340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603abff-5cc5-4327-84ba-4249e8bde548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.712979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603abff-5cc5-4327-84ba-4249e8bde548 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.713261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603abff-5cc5-4327-84ba-4249e8bde548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.713571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603abff-5cc5-4327-84ba-4249e8bde548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.714232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603abff-5cc5-4327-84ba-4249e8bde548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.715842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603abff-5cc5-4327-84ba-4249e8bde548 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.720810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40fb41-5d35-4fcc-9809-bf56ed66bf81 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.726223 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.726734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 944/1895] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:08.726843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.727158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.727434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.727901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.728084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.728177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.728449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.729970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.742705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 952/1896] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:08.746320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.749776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:08.751030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:08.758155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42108e18-cf42-4dfe-b977-d4dcee2dab75 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.760988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 945/1897] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:08.761970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.764943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.765706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.767425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.767704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] PATH_INFO: `/v3/projects/a845d39cf72a4ab99447a85614c099ee/users/70b2d5d0793a4049bb34a55d2c4b72d0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.775126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229d9b7-2b26-4e9a-8821-18144702c571 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.781808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.782730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.783068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.783505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.784180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:08.784623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.786659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.787742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a845d39cf72a4ab99447a85614c099ee, user_id=70b2d5d0793a4049bb34a55d2c4b72d0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.791745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.802008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 946/1898] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:08.802008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.816697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 953/1899] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:08 2022] PUT /identity/v3/projects/a845d39cf72a4ab99447a85614c099ee/users/70b2d5d0793a4049bb34a55d2c4b72d0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:08.817077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70002c6-3cd9-436b-bc03-d92c9985be1f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.817157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.908315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b435b-993d-474d-bc58-b3f98d698e4e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.911053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.911693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.911975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.912249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.912952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:08.913234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.914932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.919445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.920663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.921497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.922083 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] PATH_INFO: `/v3/projects/5c314a6f3fa14e42bfbc7bc34f5341a5/users/b7fb20d126ba4930accab5d002d53c23/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.938686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 947/1900] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:08.939447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.950550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3969af-33ec-4d80-93e0-a1c3b58aae2a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:08.952232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c314a6f3fa14e42bfbc7bc34f5341a5, user_id=b7fb20d126ba4930accab5d002d53c23, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.957907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:08.958609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:08.959741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.960061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:08.960405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:08.961071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:08.964822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:08.981951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 948/1901] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:08.983592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.986801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 954/1902] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:08 2022] PUT /identity/v3/projects/5c314a6f3fa14e42bfbc7bc34f5341a5/users/b7fb20d126ba4930accab5d002d53c23/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:08.994597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:08.995762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cf1a0-f013-4044-a1a2-856d9ef75af5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.076386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac8d71f-3605-44e3-b754-ed19b3160be0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.078426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f34ec-d961-44d2-a1a5-5ca327db5371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.079078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f34ec-d961-44d2-a1a5-5ca327db5371 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.079399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f34ec-d961-44d2-a1a5-5ca327db5371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.079750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f34ec-d961-44d2-a1a5-5ca327db5371 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.080395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f34ec-d961-44d2-a1a5-5ca327db5371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.082021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb3984-f337-4ce2-a9b7-402bc96b8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.082393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f34ec-d961-44d2-a1a5-5ca327db5371 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.082718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3984-f337-4ce2-a9b7-402bc96b8a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.083091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3984-f337-4ce2-a9b7-402bc96b8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.083389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb3984-f337-4ce2-a9b7-402bc96b8a7d admin admin] PATH_INFO: `/v3/projects/a845d39cf72a4ab99447a85614c099ee/users/70b2d5d0793a4049bb34a55d2c4b72d0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.085765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3984-f337-4ce2-a9b7-402bc96b8a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a845d39cf72a4ab99447a85614c099ee, user_id=70b2d5d0793a4049bb34a55d2c4b72d0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.088541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb3984-f337-4ce2-a9b7-402bc96b8a7d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.100130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 955/1903] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:08 2022] PUT /identity/v3/projects/a845d39cf72a4ab99447a85614c099ee/users/70b2d5d0793a4049bb34a55d2c4b72d0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:09.101208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.101526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.101934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.133497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 949/1904] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:08 2022] POST /identity/v3/projects => generated 361 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:09.138005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.138443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.138559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.140490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] MFA Rules not processed for user `b7fb20d126ba4930accab5d002d53c23`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:09.153544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:09.169955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] MFA Rules not processed for user `70b2d5d0793a4049bb34a55d2c4b72d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:09.171767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:09.177134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:09.220870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:09.235434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 956/1905] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:09.235434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.280660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 950/1906] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:09.281550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.330497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2078cec-6a90-4906-816e-a1494bd47a29 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.336619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.337658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.338146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.338830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.339719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.341746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.368192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bbb7d-7906-4416-ad34-73473028f752 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.370296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 957/1907] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/users => generated 281 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:09.371186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.372987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:09.375648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.376705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.377183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.377718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.378512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.380769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.428677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 951/1908] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:09.429799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.455470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc16ce-179f-45d4-bbca-f7cad72df38c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.521202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887b535-29fe-4f54-a54e-59d378abf859 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.524522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.525298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.525618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.526048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.528496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.529397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.529807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.530114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.530865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.533335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.547110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 952/1909] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:09.548256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.560329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19cc4-0240-4537-8c9b-ac7cfce469f2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.567209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.567961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.568325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.568595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.569402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.571617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.600249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 953/1910] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:09.601240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.609116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:09.615559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.617384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.618096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:09.627427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0d6f26-e82c-4af2-8ad3-29d4f39b3a7f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.633540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 958/1911] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:09.634086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.642235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.643294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.644436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.644905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.645785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.648197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f22ae0-a891-4d74-9ea3-119144fd5021 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.649236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.653107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.653843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.654194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.654543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.655305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.657007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.664489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 954/1912] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:09.670532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.672858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 959/1913] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:09.677372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.695206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759a3b-f68e-4204-820e-30d7c29ec8cd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.697020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.697788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.698071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.698347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] PATH_INFO: `/v3/projects/84e0f392bea946069a71230801d12442/users/77ae640867a64c809894bccb67712417/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.699767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529eaf2f-2cb2-4934-8ec7-f1323823c698 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.707785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.708688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.709483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.709978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.710852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.712753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.719415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e0f392bea946069a71230801d12442, user_id=77ae640867a64c809894bccb67712417, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.723012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.726162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 960/1914] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:09.727454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.731401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:09.746836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 955/1915] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:09 2022] PUT /identity/v3/projects/84e0f392bea946069a71230801d12442/users/77ae640867a64c809894bccb67712417/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:09.747777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.760473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f34c3b-e227-4423-bf0a-23cbcb1142f8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.825380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa1ceb-076b-497e-b8b6-afddcd1d29f9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:09.832384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.834123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.834123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.834627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] PATH_INFO: `/v3/users/cb3e26e61ecf4ec89f288ee5be69993e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.836876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb3e26e61ecf4ec89f288ee5be69993e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.839493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.858412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:09.859136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.859446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.860680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] PATH_INFO: `/v3/projects/d96f08913a4443ebb381dcb563394cc0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:09.862061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96f08913a4443ebb381dcb563394cc0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:09.864063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:09.912375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb3e26e61ecf4ec89f288ee5be69993e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.921336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb3e26e61ecf4ec89f288ee5be69993e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.931961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb3e26e61ecf4ec89f288ee5be69993e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.932657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb3e26e61ecf4ec89f288ee5be69993e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.945824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96f08913a4443ebb381dcb563394cc0', 'request_id': 'req-bf476550-c3c6-496f-8ba2-879f649d5f79'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.949116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb3e26e61ecf4ec89f288ee5be69993e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.954153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96f08913a4443ebb381dcb563394cc0', 'request_id': 'req-bf476550-c3c6-496f-8ba2-879f649d5f79'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.957403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 956/1916] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:09 2022] DELETE /identity/v3/users/cb3e26e61ecf4ec89f288ee5be69993e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:09.958284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:09.959934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:09.961977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96f08913a4443ebb381dcb563394cc0', 'request_id': 'req-bf476550-c3c6-496f-8ba2-879f649d5f79'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.980445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] The token cache is being invalidate because project d96f08913a4443ebb381dcb563394cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:09.981117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.981751 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bf476550-c3c6-496f-8ba2-879f649d5f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:09.983334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 961/1917] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:09 2022] DELETE /identity/v3/projects/d96f08913a4443ebb381dcb563394cc0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:09.984520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511cc37-2c0c-4625-94b7-d282864d8129 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:09.984804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511cc37-2c0c-4625-94b7-d282864d8129 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:09.985109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511cc37-2c0c-4625-94b7-d282864d8129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.017103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0511cc37-2c0c-4625-94b7-d282864d8129 None None] MFA Rules not processed for user `77ae640867a64c809894bccb67712417`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.018388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0511cc37-2c0c-4625-94b7-d282864d8129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.023907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:10.042999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7177b-7074-46ee-9215-118ff056d3de admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.047899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cae7c-85ba-4ec3-bc8a-66d50a68d788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.048568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cae7c-85ba-4ec3-bc8a-66d50a68d788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.048851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cae7c-85ba-4ec3-bc8a-66d50a68d788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.049191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cae7c-85ba-4ec3-bc8a-66d50a68d788 admin admin] PATH_INFO: `/v3/projects/948a596689fc46ea869e71b34551b3c7/users/62896e582d874d789f680a3821cb6211/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.067056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cae7c-85ba-4ec3-bc8a-66d50a68d788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948a596689fc46ea869e71b34551b3c7, user_id=62896e582d874d789f680a3821cb6211, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.070080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cae7c-85ba-4ec3-bc8a-66d50a68d788 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.074354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:10.087730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 957/1918] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:09 2022] PUT /identity/v3/projects/948a596689fc46ea869e71b34551b3c7/users/62896e582d874d789f680a3821cb6211/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:10.089312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.089825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.090276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.101506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 962/1919] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:10.103039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527c02-5ce6-4aec-9013-b729d37f1301 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.103384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527c02-5ce6-4aec-9013-b729d37f1301 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.104272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae527c02-5ce6-4aec-9013-b729d37f1301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.122540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.124648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.138359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ae527c02-5ce6-4aec-9013-b729d37f1301 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.139718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ae527c02-5ce6-4aec-9013-b729d37f1301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.214902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 963/1920] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:10.216776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.217210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.217719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.219762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 958/1921] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:10.220652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.222095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.274384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] MFA Rules not processed for user `62896e582d874d789f680a3821cb6211`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.276673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.289302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a283363-97ea-44ed-b27f-c7a42f1761eb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.293474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68253d-13b9-469f-8c07-6e75e77e59ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.294084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68253d-13b9-469f-8c07-6e75e77e59ab service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.294359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68253d-13b9-469f-8c07-6e75e77e59ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.294627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68253d-13b9-469f-8c07-6e75e77e59ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.365216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68253d-13b9-469f-8c07-6e75e77e59ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.366679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68253d-13b9-469f-8c07-6e75e77e59ab service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.389834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 959/1922] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:10.391347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.391635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.391950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.405241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 964/1923] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:10.406320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.407798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.427942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.429169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.440470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 960/1924] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:10.440470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.440470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.452870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb9a2d-84a0-4cb4-b5f3-a4c23c6c540c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.460150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.460793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.461067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.461331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] PATH_INFO: `/v3/users/77ae640867a64c809894bccb67712417` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.462664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ae640867a64c809894bccb67712417)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.464445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.482235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b4235f-d176-47d2-b9cf-82ac9e9ed1d7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.483734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:10.488505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.488505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.488896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.489531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.502403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.504252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.524498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 965/1925] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:10.525705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.527424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.535570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ae640867a64c809894bccb67712417'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:10.542381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71172548-e576-43f9-8fde-d978905ec7f9 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.547826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.548442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.548724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.549140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.550308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.550722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ae640867a64c809894bccb67712417'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:10.552276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.562584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ae640867a64c809894bccb67712417'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:10.564187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ae640867a64c809894bccb67712417'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:10.596422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ae640867a64c809894bccb67712417'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:10.604167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 966/1926] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:10.604167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.606394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.613099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:10.619088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 961/1927] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:10 2022] DELETE /identity/v3/users/77ae640867a64c809894bccb67712417 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:10.620109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.623866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.755835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb9ec7-3ce8-4213-be87-bf3227bd84e9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.763905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a2968-d2e9-4274-a7d6-9ab64ab2d036 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.768734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.769713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.770002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.770285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.771100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:10.771673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.777660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861126-cd38-4474-8964-42062ada811f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.778265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.779067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.779457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.779863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.780675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.783015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.798141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 967/1928] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:10.810921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.811450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.811951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.830285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 962/1929] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:10.835312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.857165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b105e-52a7-47da-bc0b-fea1a0252798 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.861199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:10.863217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.867641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.868275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.869785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.870021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.871945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.874201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 968/1930] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:10.875279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.883576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.888426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768e6c-3210-45b7-93de-158d07b19cab None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:10.894139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:10.895097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:10.895853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:10.896324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:10.897275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:10.899791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:10.918172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 969/1931] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:10.919390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:10.922437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:10.957719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 963/1932] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:10 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:10.959059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.079947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6cde2-a750-4995-9de6-907744ab36bb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.105294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b8793-8dd0-4a17-87e5-70fbdc7cb6f2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.111646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.113256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.113931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.114353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] PATH_INFO: `/v3/projects/8c42db3e1dc841f7a92a3f4130b5eb3e/users/00189842adbc481a8f780374ea83cba8/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.117392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:11.153798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c42db3e1dc841f7a92a3f4130b5eb3e, user_id=00189842adbc481a8f780374ea83cba8, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.163857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.190889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 964/1933] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:10 2022] PUT /identity/v3/projects/8c42db3e1dc841f7a92a3f4130b5eb3e/users/00189842adbc481a8f780374ea83cba8/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:11.190889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.255777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.255777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.255777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.256166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.292814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.294313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.295251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e1a46-aa45-4656-b04c-adc2afb04093 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.300757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.302091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.302451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.303058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.303784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.305936 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.306570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 970/1934] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:11.308061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.318219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357ea20-c848-4935-bea9-5d986f6d3cd3 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.325923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.330216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.331576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.331712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.332982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.335029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.340327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 965/1935] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:11 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:11.341248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.344351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:11.351594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 971/1936] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:11.352505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.366213 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a202c5-d44d-4301-9530-96768e6a0246 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.366430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a026d87-e3bd-4f1e-937b-0845e8690013 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.372721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.373144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.373566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.373687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.373864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.373968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.374122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.374226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] PATH_INFO: `/v3/projects/156c6b533baf460092b7895ba8b04486` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.374824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.375918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] RBAC: Authorizing `identity:delete_project(project_id=156c6b533baf460092b7895ba8b04486)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.376868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.378271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.390102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 972/1937] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:11.391337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.405249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e0b7b-a784-4e9a-ab78-616e893476a2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.412864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.413976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.414257 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.414788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] PATH_INFO: `/v3/projects/8c42db3e1dc841f7a92a3f4130b5eb3e/users/00189842adbc481a8f780374ea83cba8/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.417783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c42db3e1dc841f7a92a3f4130b5eb3e, user_id=00189842adbc481a8f780374ea83cba8, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.421676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.435536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 973/1938] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:11 2022] PUT /identity/v3/projects/8c42db3e1dc841f7a92a3f4130b5eb3e/users/00189842adbc481a8f780374ea83cba8/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:11.436742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.445028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:11.469565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '156c6b533baf460092b7895ba8b04486', 'request_id': 'req-17b7f67b-f72a-4ac4-aafb-3cf70070582e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.482622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '156c6b533baf460092b7895ba8b04486', 'request_id': 'req-17b7f67b-f72a-4ac4-aafb-3cf70070582e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.493905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '156c6b533baf460092b7895ba8b04486', 'request_id': 'req-17b7f67b-f72a-4ac4-aafb-3cf70070582e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.510397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] The token cache is being invalidate because project 156c6b533baf460092b7895ba8b04486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:11.510673 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.511548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-17b7f67b-f72a-4ac4-aafb-3cf70070582e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.514853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 966/1939] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:11 2022] DELETE /identity/v3/projects/156c6b533baf460092b7895ba8b04486 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:11.530608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.531035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.531383 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.535798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0b03bc-f270-4f47-aaa1-a1331d01dfe5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.578711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] MFA Rules not processed for user `00189842adbc481a8f780374ea83cba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:11.581656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:11.606066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.606803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.607617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.607617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.608220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.610248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.626503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 974/1940] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:11.627713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.630007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:11.649133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9656ac-0a32-4702-8b41-373922136323 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.650045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:11.656912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.657874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.658013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.658185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] PATH_INFO: `/v3/users/70b2d5d0793a4049bb34a55d2c4b72d0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.660645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b2d5d0793a4049bb34a55d2c4b72d0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.662681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.687119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 967/1941] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:11.687944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.689212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:11.715183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed8d7b0-d608-4332-943c-7c9630e4a62f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.719810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.720479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.720763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.721018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] PATH_INFO: `/v3/projects/f020917d89264bdd960ff0412f330dd6/users/48252c5cd6674648973cd7b19f891e6c/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.731878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b2d5d0793a4049bb34a55d2c4b72d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.740613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b2d5d0793a4049bb34a55d2c4b72d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.748495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f020917d89264bdd960ff0412f330dd6, user_id=48252c5cd6674648973cd7b19f891e6c, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.753573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.764619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b2d5d0793a4049bb34a55d2c4b72d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.765837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b2d5d0793a4049bb34a55d2c4b72d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.766726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b2d5d0793a4049bb34a55d2c4b72d0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:11.788910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 968/1942] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:11 2022] PUT /identity/v3/projects/f020917d89264bdd960ff0412f330dd6/users/48252c5cd6674648973cd7b19f891e6c/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:11.789590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.806560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:11.811889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 975/1943] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:11 2022] DELETE /identity/v3/users/70b2d5d0793a4049bb34a55d2c4b72d0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:11.819597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:11.823922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:11.857035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:11.888389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107bdb-cae9-45dd-8bc6-4af454465fa4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.950194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65166ea5-ca97-4168-a297-c3b321699b44 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:11.957891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.958767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.959557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.959885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] PATH_INFO: `/v3/projects/84e0f392bea946069a71230801d12442` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.961390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e0f392bea946069a71230801d12442)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:11.965149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:11.986317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:11.987803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:11.988292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:11.988757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:11.991207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.045727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e0f392bea946069a71230801d12442', 'request_id': 'req-392107ea-8696-40b6-924b-611b2ef393ca'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.059618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e0f392bea946069a71230801d12442', 'request_id': 'req-392107ea-8696-40b6-924b-611b2ef393ca'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.077716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e0f392bea946069a71230801d12442', 'request_id': 'req-392107ea-8696-40b6-924b-611b2ef393ca'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.108284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] The token cache is being invalidate because project 84e0f392bea946069a71230801d12442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:12.109709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.112003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-392107ea-8696-40b6-924b-611b2ef393ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.117872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 976/1944] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:11 2022] DELETE /identity/v3/projects/84e0f392bea946069a71230801d12442 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:12.120204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382840-c7cc-444e-923e-00c45e168365 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.121285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382840-c7cc-444e-923e-00c45e168365 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.122892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7382840-c7cc-444e-923e-00c45e168365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.137655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:12.142270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba87770-bc8e-424d-984e-387314e4c58f service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:12.166926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 969/1945] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:12.169477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.170025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.170656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.199950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a7382840-c7cc-444e-923e-00c45e168365 None None] MFA Rules not processed for user `48252c5cd6674648973cd7b19f891e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:12.201120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:12.201411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a7382840-c7cc-444e-923e-00c45e168365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.203994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.263729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:12.333434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 970/1946] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:12.334798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:12.338650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.358994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 977/1947] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:12.366925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.367235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.367522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.409829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddac9f-5345-4b4a-ad59-6fdc3f19d536 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:12.413996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:12.414614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.414894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.415164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.416131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:12.416974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.423014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.442512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 978/1948] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:12.443702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:12.447796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.481909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d551984-8d0c-4cb8-9e6e-e1586c271141 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:12.487771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:12.488402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.488682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.489101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.489828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:12.491812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:12.539960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 979/1949] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:12 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:12.539960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:12.559550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:12.563210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:12.566551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:12.600446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 971/1950] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:12.601570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:12.603894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.635951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bd0fc-158f-49f1-9ecb-e8b0935ea868 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:12.650780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:12.651532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.654061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.654061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] PATH_INFO: `/v3/projects/a845d39cf72a4ab99447a85614c099ee` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.654292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c7bc0-6bf1-4a11-90aa-0f51e25e5477 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:12.654634 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a845d39cf72a4ab99447a85614c099ee)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:12.656692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:12.661607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:12.662285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.662679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.663006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.664456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:12.664995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:12.666931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:12.699080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 980/1951] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:12.701817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:12.750871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2f593-bdd8-44ae-82aa-33faeeeb0cfb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:12.767496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a845d39cf72a4ab99447a85614c099ee', 'request_id': 'req-22171360-0e43-40c9-aec6-f72d6926b843'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.782283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a845d39cf72a4ab99447a85614c099ee', 'request_id': 'req-22171360-0e43-40c9-aec6-f72d6926b843'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.794839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a845d39cf72a4ab99447a85614c099ee', 'request_id': 'req-22171360-0e43-40c9-aec6-f72d6926b843'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.815144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:12.826507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] The token cache is being invalidate because project a845d39cf72a4ab99447a85614c099ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:12.827239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.828484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:12.830809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 972/1952] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:12 2022] DELETE /identity/v3/projects/a845d39cf72a4ab99447a85614c099ee => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:12.832524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:12.835089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:12.977088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da53c6-3cec-4d35-a7a6-0e8c44c53dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:12.977985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da53c6-3cec-4d35-a7a6-0e8c44c53dce admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.978379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da53c6-3cec-4d35-a7a6-0e8c44c53dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.978779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da53c6-3cec-4d35-a7a6-0e8c44c53dce admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.980438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22171360-0e43-40c9-aec6-f72d6926b843 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:12.992859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da53c6-3cec-4d35-a7a6-0e8c44c53dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:12.994052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:12.994778 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:12.995143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:12.995492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:12.995623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da53c6-3cec-4d35-a7a6-0e8c44c53dce admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:12.996487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.006011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.043370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 981/1953] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:12 2022] POST /identity/v3/users => generated 300 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:13.047103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.048386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.048789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.060210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 973/1954] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:12 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:13.060210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.064824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:13.099627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:13.101510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:13.196292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 982/1955] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:13.197005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.210809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c095-99c2-4a7c-8916-b095ef74fc7b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.217081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.217835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.218025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.218297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.220544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.223491 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.227319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5a5c-a368-4f37-9745-133f65bdeddc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.233637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09820d53-dc14-44bc-92aa-0bdea5950118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.234437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820d53-dc14-44bc-92aa-0bdea5950118 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.234721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820d53-dc14-44bc-92aa-0bdea5950118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.235805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09820d53-dc14-44bc-92aa-0bdea5950118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.236485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09820d53-dc14-44bc-92aa-0bdea5950118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.239670 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09820d53-dc14-44bc-92aa-0bdea5950118 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.257612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 974/1956] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:13.258991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.259331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.259615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.260003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 983/1957] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/users => generated 288 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:13.262011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.281627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a6dab-49b2-439e-b502-0be905d9ded1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.293329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:13.294825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:13.298026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.301200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.301568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.303058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] PATH_INFO: `/v3/projects/86b879ed1f94401faa4dddfcef4641d2/users/d32bfbeae13343038fa4288976b5d2d6/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.309791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 975/1958] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:13.309791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.328043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae3069-1373-495b-b8e8-d91e71882a84 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.334308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.335091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.335444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.335925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.336693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.339247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:13.339852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.347892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b879ed1f94401faa4dddfcef4641d2, user_id=d32bfbeae13343038fa4288976b5d2d6, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.351567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.363729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 976/1959] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:13.367786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.379797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 984/1960] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:13 2022] PUT /identity/v3/projects/86b879ed1f94401faa4dddfcef4641d2/users/d32bfbeae13343038fa4288976b5d2d6/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:13.380682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.386686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c57c6-7502-4946-9ee5-f395642a8dd4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.501973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.515501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.515501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.515501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.515501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:13.515501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.515501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.527963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:13.541973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4d7e2-23d9-462d-8963-ea951a83924c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.543435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 977/1961] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:13.544533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.553944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.554364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.554641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.554907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.555557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.557177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.565024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27b322-1b2a-435e-81b2-8b2bb2b7722f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.580097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.581388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.581678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.581963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.584178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 985/1962] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:13.585081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.587157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.590134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.601008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58149cc0-12a4-46c1-8f5d-0fd5aba6eead admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.605957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.606565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.606839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.607104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.607907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.609852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.615487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 978/1963] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:13.616665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.635512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae53e0-348c-4d51-a278-6fc96761164b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.646753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 986/1964] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:13.649741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.650783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.651423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.651863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.652557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] PATH_INFO: `/v3/projects/9b6f75c30fe84afc9ef8ce7b98e11664/users/b82fb4ba7caa4512a3412b082800c436/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.678548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b6f75c30fe84afc9ef8ce7b98e11664, user_id=b82fb4ba7caa4512a3412b082800c436, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.681769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.698806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 979/1965] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:13 2022] PUT /identity/v3/projects/9b6f75c30fe84afc9ef8ce7b98e11664/users/b82fb4ba7caa4512a3412b082800c436/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:13.699842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.736263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87574bf-6fcf-4149-b4c6-07f4c209ea79 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.780720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d097939-a22c-4e95-a4b3-d314202148cf admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.788505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8f22c-cf0d-4122-a5fd-98a549bec48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.789378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f22c-cf0d-4122-a5fd-98a549bec48d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.789825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f22c-cf0d-4122-a5fd-98a549bec48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.790230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8f22c-cf0d-4122-a5fd-98a549bec48d admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.790993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8f22c-cf0d-4122-a5fd-98a549bec48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.794210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8f22c-cf0d-4122-a5fd-98a549bec48d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.806771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.807745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.808485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.809171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] PATH_INFO: `/v3/projects/86b879ed1f94401faa4dddfcef4641d2/users/d32bfbeae13343038fa4288976b5d2d6/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.812034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b879ed1f94401faa4dddfcef4641d2, user_id=d32bfbeae13343038fa4288976b5d2d6, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.815995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.827351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 980/1966] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:13.827351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.827351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.827351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.837379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 987/1967] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:13 2022] PUT /identity/v3/projects/86b879ed1f94401faa4dddfcef4641d2/users/d32bfbeae13343038fa4288976b5d2d6/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:13.850790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:13.862798 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:13.887959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] MFA Rules not processed for user `b82fb4ba7caa4512a3412b082800c436`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:13.890329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:13.954786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea01ecf-60bf-4aaa-bbbf-74ec00f58812 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:13.966111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24c9fa-564b-418f-9dc5-6771758f02a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:13.967073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c9fa-564b-418f-9dc5-6771758f02a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.967362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c9fa-564b-418f-9dc5-6771758f02a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.967636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24c9fa-564b-418f-9dc5-6771758f02a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.968469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c9fa-564b-418f-9dc5-6771758f02a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:13.973385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24c9fa-564b-418f-9dc5-6771758f02a6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:13.992315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 988/1969] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:13.992591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 981/1969] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:13.994066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:13.994537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:13.994898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:13.995252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.011123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b2753-1d04-4ad8-93dc-55b5017fc341 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.017446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.018439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.019222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.020135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.022365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.027395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.064446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 982/1970] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:14.064446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.079668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] MFA Rules not processed for user `d32bfbeae13343038fa4288976b5d2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:14.082370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:14.089411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2fda8-4e40-4661-9f7e-c79e6f14e339 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.095915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.096900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.097586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.098296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.099012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.102289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.139037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 983/1971] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:14 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:14.139967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.165145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:14.196715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 989/1972] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:14.196715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.239577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff3777-d721-430f-8d3a-cbddb212e685 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.241948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d3f14-1ce1-44be-81ee-c66863dce093 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.245534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.246286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.246572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.246850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] PATH_INFO: `/v3/projects/8dcc4f55c9924def96736eaef4cd67f8/users/8e124a915bb9449ea5128f3f55f887d6/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.256455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.257279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.257738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.258164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.258962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.261061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.268077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dcc4f55c9924def96736eaef4cd67f8, user_id=8e124a915bb9449ea5128f3f55f887d6, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.271233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.290813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 984/1973] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:14 2022] PUT /identity/v3/projects/8dcc4f55c9924def96736eaef4cd67f8/users/8e124a915bb9449ea5128f3f55f887d6/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:14.291742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.291872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 990/1974] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:14 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:14.293557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:14.295765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.313799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbce06-f7a7-45ca-bff5-00890b0fcbd2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.406632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705e7c7-7db5-4da9-a0bd-6e70752b7f2a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.410550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.411165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.411446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.411716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.455603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bba8c-64c9-48b6-af00-4462d8c21400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.458268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bba8c-64c9-48b6-af00-4462d8c21400 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.458584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bba8c-64c9-48b6-af00-4462d8c21400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.460034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bba8c-64c9-48b6-af00-4462d8c21400 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.460849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bba8c-64c9-48b6-af00-4462d8c21400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.464134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bba8c-64c9-48b6-af00-4462d8c21400 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.487910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 991/1975] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:14.489474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.489694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.489974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.510530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:14.544324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] MFA Rules not processed for user `8e124a915bb9449ea5128f3f55f887d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:14.545645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:14.566718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.572113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.613743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 985/1976] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:14.618243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.635989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803670be-754b-45aa-b9ad-696350ac9649 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.641317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.642108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.642491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.642792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] PATH_INFO: `/v3/projects/4292db4bf65541319bd067741545480f/users/3c0026aa308b4e1eb0dde7e01f9f00c0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.701213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4292db4bf65541319bd067741545480f, user_id=3c0026aa308b4e1eb0dde7e01f9f00c0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.713485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.724596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 992/1977] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:14.728658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.747858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 986/1978] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:14 2022] PUT /identity/v3/projects/4292db4bf65541319bd067741545480f/users/3c0026aa308b4e1eb0dde7e01f9f00c0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:14.749101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.751226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4da8c-31b7-4f13-b3ae-3c13bb56af34 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.808824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:14.887135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7b9d1-4ac8-4bcc-bcc2-5eb7f46160b1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.894360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.895056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.895398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.895731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.896961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.898853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.900531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.901243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.901638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.901957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.902666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.904885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.921814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 987/1979] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:14.923291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:14.937762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd447-dd83-49e6-a2d5-a3678d73fd32 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:14.942689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:14.943545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:14.944084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:14.944455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] PATH_INFO: `/v3/users/48252c5cd6674648973cd7b19f891e6c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:14.946166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48252c5cd6674648973cd7b19f891e6c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:14.948258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:14.948867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 993/1980] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:14 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:14.949989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.054633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339016-fb75-45b9-a213-b6d1ef781fa5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.057109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48252c5cd6674648973cd7b19f891e6c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:15.061472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.062235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.062625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.062920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] PATH_INFO: `/v3/projects/4292db4bf65541319bd067741545480f/users/3c0026aa308b4e1eb0dde7e01f9f00c0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.065071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48252c5cd6674648973cd7b19f891e6c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:15.065225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4292db4bf65541319bd067741545480f, user_id=3c0026aa308b4e1eb0dde7e01f9f00c0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.068152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.074621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48252c5cd6674648973cd7b19f891e6c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:15.075368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48252c5cd6674648973cd7b19f891e6c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:15.083489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 994/1981] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:14 2022] PUT /identity/v3/projects/4292db4bf65541319bd067741545480f/users/3c0026aa308b4e1eb0dde7e01f9f00c0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:15.084960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.090552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:15.106967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-900a499c-0d4b-4c94-bff9-f6bf486a0b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48252c5cd6674648973cd7b19f891e6c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:15.118869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:15.132897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 988/1982] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:14 2022] DELETE /identity/v3/users/48252c5cd6674648973cd7b19f891e6c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:15.134870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb96a-e1d1-4350-bd21-d4ba55dd753b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.135450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb96a-e1d1-4350-bd21-d4ba55dd753b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.135824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb96a-e1d1-4350-bd21-d4ba55dd753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.193806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-430fb96a-e1d1-4350-bd21-d4ba55dd753b None None] MFA Rules not processed for user `3c0026aa308b4e1eb0dde7e01f9f00c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:15.195028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-430fb96a-e1d1-4350-bd21-d4ba55dd753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:15.268219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a665b57-07a8-4e29-b4ca-a8e59d74d9ab admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.350415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 989/1983] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:15.352064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.352394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.352658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.382768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:15.385260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:15.397230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:15.403232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.403682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.404033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.404658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.410232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.414784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.462324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 995/1984] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:15 2022] POST /identity/v3/users => generated 301 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:15.463402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.465323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:15.492709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 990/1985] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:15.497134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.517837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae31c4-8960-42a5-8420-4ddca92142f8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.538149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.539091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.539403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.540341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.541476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.544628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.567558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 991/1986] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:15.570754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.575082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de3d46-ec46-4963-b91c-baf8b6bff3fa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.575601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:15.580447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.581981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.582472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.582944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.585616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:15.652712 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c44ad4-7de7-402f-b6c9-7259fd813779 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.658310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.658854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.659080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.659467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.659788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.660402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.670372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 996/1987] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:15.671225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.672007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.673753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.687174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 992/1988] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:15.688498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb386f31-e3f9-42bd-b52a-08a55ea2f0b8 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.697793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.700874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.701166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.701536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] PATH_INFO: `/v3/projects/bf93b94682c442e2ba1efd41f8a40f1e/users/65edb708954f4a32beca6a4f50781b62/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.707964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:15.727889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf93b94682c442e2ba1efd41f8a40f1e, user_id=65edb708954f4a32beca6a4f50781b62, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.732377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.759613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 997/1989] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:15 2022] PUT /identity/v3/projects/bf93b94682c442e2ba1efd41f8a40f1e/users/65edb708954f4a32beca6a4f50781b62/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:15.763702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.775643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5642f2d-7e6e-44b1-8f64-dbe721187fb3 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.868591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864a8f4-5238-4e16-a5d8-afddf52ff00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.869644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864a8f4-5238-4e16-a5d8-afddf52ff00c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.869965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864a8f4-5238-4e16-a5d8-afddf52ff00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.870488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864a8f4-5238-4e16-a5d8-afddf52ff00c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.871688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864a8f4-5238-4e16-a5d8-afddf52ff00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.874850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864a8f4-5238-4e16-a5d8-afddf52ff00c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.889149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 993/1990] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:15.892950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:15.904115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186cf0ee-e941-473b-a816-e45cfc92beac admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:15.909477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:15.910158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.910453 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.910723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] PATH_INFO: `/v3/projects/bf93b94682c442e2ba1efd41f8a40f1e/users/65edb708954f4a32beca6a4f50781b62/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:15.912863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf93b94682c442e2ba1efd41f8a40f1e, user_id=65edb708954f4a32beca6a4f50781b62, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:15.915860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:15.938761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 998/1991] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:15 2022] PUT /identity/v3/projects/bf93b94682c442e2ba1efd41f8a40f1e/users/65edb708954f4a32beca6a4f50781b62/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:15.951604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:15.951892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:15.952163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:16.026295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] MFA Rules not processed for user `65edb708954f4a32beca6a4f50781b62`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:16.028261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:16.118842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:16.219398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 994/1992] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:15 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:16.228668 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:16.310300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd7943-f39d-4863-b9a4-256f4e7af802 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:16.315261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:16.315597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:16.315774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:16.316036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:16.326379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:16.327852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:16.339564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 999/1993] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:16.468853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:16.470357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:16.506056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:16.570074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ced3-c815-47cd-b8f1-f7946a6ab441 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:16.575965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:16.576666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:16.576946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:16.577756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] PATH_INFO: `/v3/projects/f020917d89264bdd960ff0412f330dd6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:16.579006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f020917d89264bdd960ff0412f330dd6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:16.581527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:16.589488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b095c5-cac7-422a-878f-4e6541fbd60b service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:16.595477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:16.596209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:16.597151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:16.597447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] PATH_INFO: `/v3/users/8e124a915bb9449ea5128f3f55f887d6` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:16.598864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e124a915bb9449ea5128f3f55f887d6)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:16.600829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:16.645577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f020917d89264bdd960ff0412f330dd6', 'request_id': 'req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.658119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f020917d89264bdd960ff0412f330dd6', 'request_id': 'req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.667630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f020917d89264bdd960ff0412f330dd6', 'request_id': 'req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.685645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] The token cache is being invalidate because project f020917d89264bdd960ff0412f330dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:16.686060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.686816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.689392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 995/1994] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:16 2022] DELETE /identity/v3/projects/f020917d89264bdd960ff0412f330dd6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:16.694999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:16.701928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:16.704481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e124a915bb9449ea5128f3f55f887d6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.719458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e124a915bb9449ea5128f3f55f887d6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.753401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e124a915bb9449ea5128f3f55f887d6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.755224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e124a915bb9449ea5128f3f55f887d6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.756209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e124a915bb9449ea5128f3f55f887d6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.760197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:16.794408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:16.802602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8a7a-d279-4125-a693-cf7b9798ce9a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:16.810547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1000/1995] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:16 2022] DELETE /identity/v3/users/8e124a915bb9449ea5128f3f55f887d6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:16.810547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:16.811513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:16.901255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:16.902463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:16.903275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:16.903813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] PATH_INFO: `/v3/users/d32bfbeae13343038fa4288976b5d2d6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:16.905291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d32bfbeae13343038fa4288976b5d2d6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:16.907443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:16.925546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe200c8-3bb2-46e1-a123-a7019fb830ef admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:16.933989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:16.935141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:16.935972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:16.936535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] PATH_INFO: `/v3/users/b7fb20d126ba4930accab5d002d53c23` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:16.938299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7fb20d126ba4930accab5d002d53c23)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:16.941117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:16.966897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd32bfbeae13343038fa4288976b5d2d6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:16.999196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd32bfbeae13343038fa4288976b5d2d6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.010680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7fb20d126ba4930accab5d002d53c23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.012316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd32bfbeae13343038fa4288976b5d2d6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.012970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd32bfbeae13343038fa4288976b5d2d6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.027365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7fb20d126ba4930accab5d002d53c23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.032052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-82ea843b-ba9b-4fb1-b08b-b49693f4946b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd32bfbeae13343038fa4288976b5d2d6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.043450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 996/1996] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:16 2022] DELETE /identity/v3/users/d32bfbeae13343038fa4288976b5d2d6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:17.045897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:17.046123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:17.046487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:17.058235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7fb20d126ba4930accab5d002d53c23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.058964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7fb20d126ba4930accab5d002d53c23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.059586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8314c7a6-0e23-4fd5-9b94-865342eec7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7fb20d126ba4930accab5d002d53c23'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.078481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:17.078821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1001/1997] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:16 2022] DELETE /identity/v3/users/b7fb20d126ba4930accab5d002d53c23 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:17.084519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:17.084724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:17.085050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:17.095720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:17.111620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:17.113902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:17.189639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1002/1998] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:17.281395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:17.281395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:17.305457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:17.319212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 997/1999] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:17.361820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:17.364869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:17.426922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:17.434799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6f58d-3922-4a27-b8e4-c7eacb425efc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:17.474698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:17.476290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:17.477895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:17.478432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:17.494992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227045dd-b094-4d74-8c09-b0e7deec99eb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:17.502030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b14b2a-0536-4cba-baab-928db25410d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:17.503355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14b2a-0536-4cba-baab-928db25410d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:17.503639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14b2a-0536-4cba-baab-928db25410d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:17.503917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14b2a-0536-4cba-baab-928db25410d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:17.505735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:17.508214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:17.529223 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1003/2000] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:17.548650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b14b2a-0536-4cba-baab-928db25410d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:17.551478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b14b2a-0536-4cba-baab-928db25410d0 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:17.583695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 998/2001] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:17.796442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:17.799355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:17.838367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f0d4-d431-47d5-a265-254777e78049 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:17.844805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:17.846211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:17.847441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:17.847735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] PATH_INFO: `/v3/projects/86b879ed1f94401faa4dddfcef4641d2` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:17.848981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b879ed1f94401faa4dddfcef4641d2)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:17.851475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:17.918722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b879ed1f94401faa4dddfcef4641d2', 'request_id': 'req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.929615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b879ed1f94401faa4dddfcef4641d2', 'request_id': 'req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.939375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b879ed1f94401faa4dddfcef4641d2', 'request_id': 'req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.955108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] The token cache is being invalidate because project 86b879ed1f94401faa4dddfcef4641d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:17.955678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.956948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:17.959735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1004/2002] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:17 2022] DELETE /identity/v3/projects/86b879ed1f94401faa4dddfcef4641d2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:17.966664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51574fc-227d-454d-945a-43cdeb882765 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:17.966960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51574fc-227d-454d-945a-43cdeb882765 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:17.967245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51574fc-227d-454d-945a-43cdeb882765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:17.990381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c51574fc-227d-454d-945a-43cdeb882765 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:17.992091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c51574fc-227d-454d-945a-43cdeb882765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.039943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.041885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.089394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 999/2003] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:18.097875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.098191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.098471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.122206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:18.123660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.137073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1000/2004] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:18.138248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.141207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba1856c-b5d5-4781-a3d9-09fe1151dbda admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.152014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b71c54-efc7-42b4-9a3e-15c4f3214e44 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.156679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.160412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.160514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.160621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.161220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.161550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.161838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.162043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] PATH_INFO: `/v3/projects/8dcc4f55c9924def96736eaef4cd67f8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.162617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:18.162924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.164849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.169744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dcc4f55c9924def96736eaef4cd67f8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.171941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.189697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1001/2005] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:18.191416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.193363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.210944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfc305-929a-452f-aed7-0f9445f5ab4e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.217753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.218397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.218684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.218961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] PATH_INFO: `/v3/projects/5c314a6f3fa14e42bfbc7bc34f5341a5` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.220141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c314a6f3fa14e42bfbc7bc34f5341a5)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.222181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.231269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:18.241621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dcc4f55c9924def96736eaef4cd67f8', 'request_id': 'req-314b5281-97c6-440d-be06-971d2f2cb3ab'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.249597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dcc4f55c9924def96736eaef4cd67f8', 'request_id': 'req-314b5281-97c6-440d-be06-971d2f2cb3ab'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.256935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dcc4f55c9924def96736eaef4cd67f8', 'request_id': 'req-314b5281-97c6-440d-be06-971d2f2cb3ab'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.268285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] The token cache is being invalidate because project 8dcc4f55c9924def96736eaef4cd67f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:18.268572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.269296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.270788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1005/2006] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:18 2022] DELETE /identity/v3/projects/8dcc4f55c9924def96736eaef4cd67f8 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:18.271526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.272881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.274278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c314a6f3fa14e42bfbc7bc34f5341a5', 'request_id': 'req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.282054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c314a6f3fa14e42bfbc7bc34f5341a5', 'request_id': 'req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.288759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c314a6f3fa14e42bfbc7bc34f5341a5', 'request_id': 'req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.301773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] The token cache is being invalidate because project 5c314a6f3fa14e42bfbc7bc34f5341a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:18.302059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.302741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.304257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1002/2007] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:18 2022] DELETE /identity/v3/projects/5c314a6f3fa14e42bfbc7bc34f5341a5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:18.305020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.306333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.338089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:18.342094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b5281-97c6-440d-be06-971d2f2cb3ab admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.374470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0999fbf-f8b8-4495-81b8-bc03ddb2475f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.379244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.379872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.380153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.380423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] PATH_INFO: `/v3/users/65edb708954f4a32beca6a4f50781b62` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.381588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65edb708954f4a32beca6a4f50781b62)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.383539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.401970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.402595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.402877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.403151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.403785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.405885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.432751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65edb708954f4a32beca6a4f50781b62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.435486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1006/2008] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:18 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:18.436432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.439735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.440320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65edb708954f4a32beca6a4f50781b62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.447746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65edb708954f4a32beca6a4f50781b62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.448482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65edb708954f4a32beca6a4f50781b62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.460916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65edb708954f4a32beca6a4f50781b62'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.467046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1003/2009] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:18 2022] DELETE /identity/v3/users/65edb708954f4a32beca6a4f50781b62 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:18.467811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.469198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.510319 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e1538-855f-4c5f-8142-cd9a2e684d27 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.515127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:18.557248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffddd99-7abe-45da-be6d-84690608fb77 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.567645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.568286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.568569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.568845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.569529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.571559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.593191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.594394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.594757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.595109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] PATH_INFO: `/v3/users/62896e582d874d789f680a3821cb6211` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.597772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62896e582d874d789f680a3821cb6211)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.598690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1004/2010] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:18 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:18.598690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.602994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.605224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.627017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284524d-71e6-4888-beff-59f3aecad386 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.636440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.639272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.639668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.639904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] PATH_INFO: `/v3/users/b82fb4ba7caa4512a3412b082800c436` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.642021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82fb4ba7caa4512a3412b082800c436)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.644590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.679704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62896e582d874d789f680a3821cb6211'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.691652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:18.698359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62896e582d874d789f680a3821cb6211'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.714583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82fb4ba7caa4512a3412b082800c436'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.723564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62896e582d874d789f680a3821cb6211'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.723711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82fb4ba7caa4512a3412b082800c436'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.723950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62896e582d874d789f680a3821cb6211'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.724646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62896e582d874d789f680a3821cb6211'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.735273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82fb4ba7caa4512a3412b082800c436'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.736041 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82fb4ba7caa4512a3412b082800c436'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.751887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1007/2011] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:18 2022] DELETE /identity/v3/users/62896e582d874d789f680a3821cb6211 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:18.753849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.756079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.760982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c81c4802-9b05-45f0-b368-ff91d3b1d58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82fb4ba7caa4512a3412b082800c436'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:18.772242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1005/2012] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:18 2022] DELETE /identity/v3/users/b82fb4ba7caa4512a3412b082800c436 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:18.776919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.777212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.777535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.798893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:18.801252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.843621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0312f-4f7c-4b19-b183-ecbb4c19c49c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.913245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:18.919696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1006/2013] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:18.920986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.922851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:18.939448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613813a1-69ca-4037-a3e4-a0bfae4d1109 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:18.945315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.946271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.946781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.947172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] PATH_INFO: `/v3/projects/bf93b94682c442e2ba1efd41f8a40f1e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.948812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf93b94682c442e2ba1efd41f8a40f1e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.951096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.952396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:18.953492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:18.954199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:18.954610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:18.955401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:18.958037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:18.974114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1008/2014] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:18.984195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:18.986376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.081608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf93b94682c442e2ba1efd41f8a40f1e', 'request_id': 'req-7616e7da-1bec-4111-989a-63bafc67fc3e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.086484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2f19f-fbee-48a1-b753-d912eaf649bd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.097553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf93b94682c442e2ba1efd41f8a40f1e', 'request_id': 'req-7616e7da-1bec-4111-989a-63bafc67fc3e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.109401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf93b94682c442e2ba1efd41f8a40f1e', 'request_id': 'req-7616e7da-1bec-4111-989a-63bafc67fc3e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.125625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] The token cache is being invalidate because project bf93b94682c442e2ba1efd41f8a40f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:19.126114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.127617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.129385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1007/2015] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:18 2022] DELETE /identity/v3/projects/bf93b94682c442e2ba1efd41f8a40f1e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:19.130370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.132134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.165655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.166287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.166569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.166847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.168641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.191362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:19.231435 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616e7da-1bec-4111-989a-63bafc67fc3e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.236919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a53e5-33fd-46e9-b656-d1f52bcf44d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.238111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a53e5-33fd-46e9-b656-d1f52bcf44d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.238532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a53e5-33fd-46e9-b656-d1f52bcf44d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.238800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a53e5-33fd-46e9-b656-d1f52bcf44d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.239482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a53e5-33fd-46e9-b656-d1f52bcf44d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.241088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a53e5-33fd-46e9-b656-d1f52bcf44d3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.248918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.250403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.252125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1008/2016] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:19.253559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.253849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.254127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.261592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1009/2017] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:19.262276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.263635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.275476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471a7fe-f2f6-4b00-8c03-d0d15952c84d service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.277377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:19.278810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.280459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.281096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.281400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.281680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] PATH_INFO: `/v3/projects/948a596689fc46ea869e71b34551b3c7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.282815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=948a596689fc46ea869e71b34551b3c7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.285279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.289598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1009/2018] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:19.290582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.302577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd281d8-b286-4d39-ba3c-b11bfbafa38c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.308761 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f6fd2-93f9-42d9-9423-badbb77a4bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.309538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6fd2-93f9-42d9-9423-badbb77a4bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.309817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6fd2-93f9-42d9-9423-badbb77a4bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.310147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f6fd2-93f9-42d9-9423-badbb77a4bce admin admin] PATH_INFO: `/v3/projects/d8354c9cf12441b4a36af793477b80a6/users/9aa9db920f10441bb41a95feca5585f2/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.327900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f6fd2-93f9-42d9-9423-badbb77a4bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8354c9cf12441b4a36af793477b80a6, user_id=9aa9db920f10441bb41a95feca5585f2, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.330268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:19.330672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f6fd2-93f9-42d9-9423-badbb77a4bce admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.346045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948a596689fc46ea869e71b34551b3c7', 'request_id': 'req-d276da78-7264-47ee-969c-232fc1b9fbdc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.351097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1010/2019] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:19 2022] PUT /identity/v3/projects/d8354c9cf12441b4a36af793477b80a6/users/9aa9db920f10441bb41a95feca5585f2/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:19.353710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.354366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.355118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.358315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948a596689fc46ea869e71b34551b3c7', 'request_id': 'req-d276da78-7264-47ee-969c-232fc1b9fbdc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.367005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948a596689fc46ea869e71b34551b3c7', 'request_id': 'req-d276da78-7264-47ee-969c-232fc1b9fbdc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.382226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] The token cache is being invalidate because project 948a596689fc46ea869e71b34551b3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:19.382508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.383208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d276da78-7264-47ee-969c-232fc1b9fbdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.384909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1010/2020] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:19 2022] DELETE /identity/v3/projects/948a596689fc46ea869e71b34551b3c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:19.386110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:19.386288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.386568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.386838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.387686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.412491 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:19.414139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.465191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1011/2021] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:19.466088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.475069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.494226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c2bf7-3cee-4f1a-922b-84d6223cbd45 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.500416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.501203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.501555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.501791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] PATH_INFO: `/v3/users/00189842adbc481a8f780374ea83cba8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.504287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00189842adbc481a8f780374ea83cba8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.506368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.509219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1011/2022] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:19.511002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.533269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d538a4-2717-4156-8ffb-51842da11e52 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.555648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.556376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.556739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.557018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.557794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:19.558106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.560204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.582441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1012/2023] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:19.583343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.585376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.588286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00189842adbc481a8f780374ea83cba8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.606874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00189842adbc481a8f780374ea83cba8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.616117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00189842adbc481a8f780374ea83cba8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.616970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00189842adbc481a8f780374ea83cba8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.643793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00189842adbc481a8f780374ea83cba8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:19.658573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1012/2024] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:19 2022] DELETE /identity/v3/users/00189842adbc481a8f780374ea83cba8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:19.659840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.662385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.677187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bb6e6-171e-4801-b400-709f573ac1c2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.703163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:19.753363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.754109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.754391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.754664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.756585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.783476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:19.804357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f971a116-cbe1-4129-a229-b7e0d6174521 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.810850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.811566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.811849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.812189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.812882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.815921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.860251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.861454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.874682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1013/2025] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:19.875652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.879253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:19.881216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1013/2026] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:19 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:19.885622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:19.892293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0017cc30-818a-406c-9f27-49d182a9400a service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:19.974663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:19.975175 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:19.975451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:19.975856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] PATH_INFO: `/v3/projects/9b6f75c30fe84afc9ef8ce7b98e11664` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:19.979226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b6f75c30fe84afc9ef8ce7b98e11664)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:19.981366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:19.997565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2fded-0de8-400c-a2b4-fdb160ca049c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.006016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.006942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.007368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.008019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.009005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.011374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.040227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1014/2027] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:19 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:20.044424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.060299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e573c-6342-4e49-a67b-a85c2c8bfecd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.071666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b6f75c30fe84afc9ef8ce7b98e11664', 'request_id': 'req-1368623e-c1bb-431d-b548-095d88b0c907'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.085239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b6f75c30fe84afc9ef8ce7b98e11664', 'request_id': 'req-1368623e-c1bb-431d-b548-095d88b0c907'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.095280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b6f75c30fe84afc9ef8ce7b98e11664', 'request_id': 'req-1368623e-c1bb-431d-b548-095d88b0c907'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.127227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] The token cache is being invalidate because project 9b6f75c30fe84afc9ef8ce7b98e11664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:20.127578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.129442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.179006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1014/2028] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:19 2022] DELETE /identity/v3/projects/9b6f75c30fe84afc9ef8ce7b98e11664 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:20.184987 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.186535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.200196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.200196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.200196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.200196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.200617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.206556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.232437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1015/2029] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:20.232437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.233588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368623e-c1bb-431d-b548-095d88b0c907 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.239404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.249278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.249957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.250235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.250855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] PATH_INFO: `/v3/users/3c0026aa308b4e1eb0dde7e01f9f00c0` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.254833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0026aa308b4e1eb0dde7e01f9f00c0)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.256810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.261329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef1233-42db-4983-96b9-368e5ed2a7fc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.277540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.278635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.279074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.279505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] PATH_INFO: `/v3/projects/8c42db3e1dc841f7a92a3f4130b5eb3e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.281562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c42db3e1dc841f7a92a3f4130b5eb3e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.283737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.319353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:20.335472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:20.349893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0026aa308b4e1eb0dde7e01f9f00c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.368759 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0026aa308b4e1eb0dde7e01f9f00c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.369299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c42db3e1dc841f7a92a3f4130b5eb3e', 'request_id': 'req-a08b8dd5-623c-4a10-9556-0de077c5951c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.381966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c42db3e1dc841f7a92a3f4130b5eb3e', 'request_id': 'req-a08b8dd5-623c-4a10-9556-0de077c5951c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.392042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c42db3e1dc841f7a92a3f4130b5eb3e', 'request_id': 'req-a08b8dd5-623c-4a10-9556-0de077c5951c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.403366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0026aa308b4e1eb0dde7e01f9f00c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.404300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0026aa308b4e1eb0dde7e01f9f00c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.405849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-25d196e6-92e1-4553-b3b3-d1db19090525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0026aa308b4e1eb0dde7e01f9f00c0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.417018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] The token cache is being invalidate because project 8c42db3e1dc841f7a92a3f4130b5eb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:20.418144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.420156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:20.423929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1016/2030] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:20 2022] DELETE /identity/v3/projects/8c42db3e1dc841f7a92a3f4130b5eb3e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:20.426335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.440923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1015/2031] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:20 2022] DELETE /identity/v3/users/3c0026aa308b4e1eb0dde7e01f9f00c0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:20.440923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717458-d1c9-4be8-8fa7-0881a17fbb87 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.440923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717458-d1c9-4be8-8fa7-0881a17fbb87 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.440923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717458-d1c9-4be8-8fa7-0881a17fbb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.460628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.471700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9a717458-d1c9-4be8-8fa7-0881a17fbb87 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:20.473216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9a717458-d1c9-4be8-8fa7-0881a17fbb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.565824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8dd5-623c-4a10-9556-0de077c5951c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.646318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1016/2032] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:20.651058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.652580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.653123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.658420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.660641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.661076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.661542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.663902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.667194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.688758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1017/2033] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:20.693441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.700100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:20.701624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.714983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1017/2034] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:20.715518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec38210-587a-461a-94e0-cfb3393e5dda admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.716926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.723266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc344f7-ce22-4752-81c1-948c07008b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.724319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc344f7-ce22-4752-81c1-948c07008b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.724744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc344f7-ce22-4752-81c1-948c07008b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.725170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc344f7-ce22-4752-81c1-948c07008b85 admin admin] PATH_INFO: `/v3/projects/13273b53116a444284e8620a30d997d7/users/4a4cc922ad0c470cab0875104df5824d/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.730446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9f26f-47df-42b6-b44a-4efeaecaf132 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.738997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.739764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.740144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.740520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.741513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:20.741953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.744354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.756837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc344f7-ce22-4752-81c1-948c07008b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13273b53116a444284e8620a30d997d7, user_id=4a4cc922ad0c470cab0875104df5824d, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.761830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc344f7-ce22-4752-81c1-948c07008b85 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.785416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1018/2035] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:20.787994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.788313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1018/2036] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:20 2022] PUT /identity/v3/projects/13273b53116a444284e8620a30d997d7/users/4a4cc922ad0c470cab0875104df5824d/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:20.800134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.802378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.802378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.820096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1fc43-ae4f-4f61-a50e-a3afdf5023cb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:20.833624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] MFA Rules not processed for user `4a4cc922ad0c470cab0875104df5824d`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:20.836308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.860959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:20.912953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:20.913558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:20.913823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:20.914057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:20.915031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:20.918028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:20.940825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1019/2037] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:20.957656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.958201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1019/2038] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:20 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:20.959847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:20.962968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:20.995197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:21.090058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ecca1-aead-4003-9106-ff82766c75f1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.103569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.104218 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.104502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.105927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.106612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.113215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.147190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c98116-29ce-4466-9896-512ae1a358c3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.170571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1020/2039] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:20 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:21.175693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.184993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.228170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab327914-7f94-4a20-88f6-d4f2f029b837 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.245272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.246466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.247003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.247445 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] PATH_INFO: `/v3/projects/4292db4bf65541319bd067741545480f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.256181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4292db4bf65541319bd067741545480f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.266557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.308384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902f87a-9d01-4236-89c1-29027114b431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.309002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f87a-9d01-4236-89c1-29027114b431 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.309281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f87a-9d01-4236-89c1-29027114b431 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.309575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902f87a-9d01-4236-89c1-29027114b431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.370850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4292db4bf65541319bd067741545480f', 'request_id': 'req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.391242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4292db4bf65541319bd067741545480f', 'request_id': 'req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.412494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4292db4bf65541319bd067741545480f', 'request_id': 'req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.431996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] The token cache is being invalidate because project 4292db4bf65541319bd067741545480f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:21.432348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.433423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.435677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1021/2040] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:21 2022] DELETE /identity/v3/projects/4292db4bf65541319bd067741545480f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:21.441307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.443626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.451707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f87a-9d01-4236-89c1-29027114b431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.453545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902f87a-9d01-4236-89c1-29027114b431 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.474584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1020/2041] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:21.476047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.476377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.476566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.535964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] MFA Rules not processed for user `9aa9db920f10441bb41a95feca5585f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:21.537623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.550236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6be6d-14e6-496b-96a8-bb4fb9c24fdb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.555371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8e66-a175-4ddc-b0c7-984a5a880e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.556227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:21.556348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8e66-a175-4ddc-b0c7-984a5a880e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.556679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8e66-a175-4ddc-b0c7-984a5a880e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.557105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8e66-a175-4ddc-b0c7-984a5a880e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.558305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a8e66-a175-4ddc-b0c7-984a5a880e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.560381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a8e66-a175-4ddc-b0c7-984a5a880e24 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.572426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1022/2042] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:21.574635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.574929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.575203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.600115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:21.601535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.609774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1023/2043] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:21.610682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.617666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.621803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1021/2044] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:21.622843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.629871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04806c0c-af70-4b47-a46c-61638f5e8f1a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.636203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.636877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.637239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.637618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] PATH_INFO: `/v3/users/4a4cc922ad0c470cab0875104df5824d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.638451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfcfef-7612-4cbf-aec9-8d02a0979106 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.638770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4cc922ad0c470cab0875104df5824d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.640696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.645316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a04754-b7b2-4992-b316-86a5da19fb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.645963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a04754-b7b2-4992-b316-86a5da19fb44 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.647212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a04754-b7b2-4992-b316-86a5da19fb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.647601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a04754-b7b2-4992-b316-86a5da19fb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.649193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a04754-b7b2-4992-b316-86a5da19fb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.652370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a04754-b7b2-4992-b316-86a5da19fb44 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.662784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:21.663361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1022/2045] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:21.664715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.665148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.665546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.692931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:21.694458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.705236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1023/2046] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:21.706082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.707476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.724710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4cc922ad0c470cab0875104df5824d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.734264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4cc922ad0c470cab0875104df5824d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.755052 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4cc922ad0c470cab0875104df5824d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.757088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4cc922ad0c470cab0875104df5824d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.758796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4cc922ad0c470cab0875104df5824d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:21.773517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e24846-d499-4500-a470-ce3dc5c89c49 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.778515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.779944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1024/2047] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:21 2022] DELETE /identity/v3/users/4a4cc922ad0c470cab0875104df5824d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:21.783090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.783090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.787888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.788302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.788592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.790579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.803974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.805362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.816455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1024/2048] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:21.817387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.818788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.834006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde87e0-8001-4c1e-858d-c77a678ec82b service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.888486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da99e4-cb60-4d3a-b155-76d8e9111739 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:21.893521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.894259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.894600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.894935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] PATH_INFO: `/v3/projects/909c2d2502244c4bbb221eeebd9cd925/users/b730175359574ef489da7ead3ab3207f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.899652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:21.900337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.900686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.901023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.901769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:21.902139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.903816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef1cc0-48bf-4101-9e5a-a50a5b8b7a24 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.913731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909c2d2502244c4bbb221eeebd9cd925, user_id=b730175359574ef489da7ead3ab3207f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:21.916433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:21.917280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1025/2049] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:21.919018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490318a3-6ab3-4824-a402-b67981af1374 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:21.919318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490318a3-6ab3-4824-a402-b67981af1374 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:21.920107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490318a3-6ab3-4824-a402-b67981af1374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:21.937115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1025/2050] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:21 2022] PUT /identity/v3/projects/909c2d2502244c4bbb221eeebd9cd925/users/b730175359574ef489da7ead3ab3207f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:21.938670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:21.944061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-490318a3-6ab3-4824-a402-b67981af1374 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:21.945446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-490318a3-6ab3-4824-a402-b67981af1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:21.978500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:22.015538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffc85a-e226-4f88-8284-ef753718a9d0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.017509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1026/2051] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:22.018762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.019150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.019329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.025099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.025827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.026240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.026593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.027295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.029377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.053069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] MFA Rules not processed for user `b730175359574ef489da7ead3ab3207f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:22.054476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.064003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1026/2052] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:21 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:22.064003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.066458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.072980 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:22.146480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20df38-c524-46ca-963f-fffc629831ea admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.151465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1027/2053] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:22.151465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.158420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.160942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.162075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.162374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.178923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68b701-1765-450e-b71e-4e348bf55408 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.253326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.255362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.267245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1027/2054] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:22.274900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.275938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.276370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.276788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.277618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.280232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.280424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.295792 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c0650-0774-4bb4-b463-02fb4a47abee service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.304620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.306097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.306684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.307134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.308416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.312595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.318665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1028/2055] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:22 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:22.320054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.340942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbf6ca-b535-4413-b450-69cf1cd5b2cd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.349287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.350262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.350752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.351183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.352416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.354242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.362974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1028/2056] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:22 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:22.371720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.371986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1029/2057] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:22.372827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.401260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bff45-348b-4b2f-adc1-d3985c319a76 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.464870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe165bc-dc8e-4354-9a2f-efedeada6836 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.468897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:22.470035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.470717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.472803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.472803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.472803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.474938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.492137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.492957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.493234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.494094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.494877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.496721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.500746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1029/2058] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:22 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:22.504785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.511038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1030/2059] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:22.515115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.515656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5c87a-f907-4666-906a-c3e16425644f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.522733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.523479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.523710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.524048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.524863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.527003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.532899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a178b-a124-4b33-8a7f-8b746415993c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.540011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6af9dd-7af9-4169-a3dc-1edcad3012a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.541131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af9dd-7af9-4169-a3dc-1edcad3012a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.541530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af9dd-7af9-4169-a3dc-1edcad3012a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.541815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6af9dd-7af9-4169-a3dc-1edcad3012a0 admin admin] PATH_INFO: `/v3/projects/d979f351dbd142b2b1d5c0c05890be90/users/d5b07a45a49b4137827caaa7c4eb46c9/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.549587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1030/2060] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:22.550689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.563635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af9dd-7af9-4169-a3dc-1edcad3012a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d979f351dbd142b2b1d5c0c05890be90, user_id=d5b07a45a49b4137827caaa7c4eb46c9, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.564143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2195918-c41d-4b03-9308-34ceeaa9e012 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.567649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6af9dd-7af9-4169-a3dc-1edcad3012a0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.577881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.578862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.579174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.579536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] PATH_INFO: `/v3/projects/5ab36266851048e4a7d1570ec1403bee/users/eebc9d78176742b2b2524956755c737d/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.585515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:22.588811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1031/2061] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:22 2022] PUT /identity/v3/projects/d979f351dbd142b2b1d5c0c05890be90/users/d5b07a45a49b4137827caaa7c4eb46c9/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:22.599942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.600139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.600539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.618343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab36266851048e4a7d1570ec1403bee, user_id=eebc9d78176742b2b2524956755c737d, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.626081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.636622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] MFA Rules not processed for user `d5b07a45a49b4137827caaa7c4eb46c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:22.637990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.641955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1031/2062] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:22 2022] PUT /identity/v3/projects/5ab36266851048e4a7d1570ec1403bee/users/eebc9d78176742b2b2524956755c737d/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:22.648258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.733129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1032/2063] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:22.734149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.735620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.740383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f7f2be-5607-4a56-a632-bfe063fb8a52 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.746482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.747093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.747368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.747636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.748280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.749905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.766473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855966a8-a3ee-448b-80b3-876cefd07880 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.771347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1032/2064] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:22.771347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.771347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.771638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.771840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.772121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.772391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] PATH_INFO: `/v3/projects/13273b53116a444284e8620a30d997d7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.773642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13273b53116a444284e8620a30d997d7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.775585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.829068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13273b53116a444284e8620a30d997d7', 'request_id': 'req-8e6cacdb-ea46-4434-9760-79cbd468bf47'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:22.838144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13273b53116a444284e8620a30d997d7', 'request_id': 'req-8e6cacdb-ea46-4434-9760-79cbd468bf47'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:22.847859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13273b53116a444284e8620a30d997d7', 'request_id': 'req-8e6cacdb-ea46-4434-9760-79cbd468bf47'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:22.859843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] The token cache is being invalidate because project 13273b53116a444284e8620a30d997d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:22.860134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:22.860809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:22.861473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87986c-e941-4712-abbe-82cba9d8451a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.863998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1033/2065] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:22 2022] DELETE /identity/v3/projects/13273b53116a444284e8620a30d997d7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:22.864707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:22.870708 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.907482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:22.938876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.939614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.940054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.940503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.942594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:22.952613 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cacdb-ea46-4434-9760-79cbd468bf47 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:22.962574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe8917-fd26-4069-a5d5-a97b3653cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:22.963603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8917-fd26-4069-a5d5-a97b3653cdad admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.964057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8917-fd26-4069-a5d5-a97b3653cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.965320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8917-fd26-4069-a5d5-a97b3653cdad admin admin] PATH_INFO: `/v3/projects/5ab36266851048e4a7d1570ec1403bee/users/eebc9d78176742b2b2524956755c737d/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:22.969557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe8917-fd26-4069-a5d5-a97b3653cdad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab36266851048e4a7d1570ec1403bee, user_id=eebc9d78176742b2b2524956755c737d, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:22.975794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe8917-fd26-4069-a5d5-a97b3653cdad admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:22.978990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:22.994043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1034/2066] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:22 2022] PUT /identity/v3/projects/5ab36266851048e4a7d1570ec1403bee/users/eebc9d78176742b2b2524956755c737d/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:22.994043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50b8b-4c13-4a07-b452-917e95553e12 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:22.994043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50b8b-4c13-4a07-b452-917e95553e12 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:22.994043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f50b8b-4c13-4a07-b452-917e95553e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.013448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-21f50b8b-4c13-4a07-b452-917e95553e12 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:23.014904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-21f50b8b-4c13-4a07-b452-917e95553e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.019142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.020615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024c74e-8941-4b1e-8739-a4befc2c3e5a service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.031473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1033/2067] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:23.032827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.033108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.033399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.069008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] MFA Rules not processed for user `eebc9d78176742b2b2524956755c737d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:23.070269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.110336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1035/2068] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:23.119710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.120090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.120513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.156738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:23.162034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.172758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1036/2069] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:23.177477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.188864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff1d48-746a-4fad-8d99-94a47aae0630 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.194710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.195590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.195878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.195990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1034/2070] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:23 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:23.196154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.196814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:23.197174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.198840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.217501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1037/2071] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:42:23.222688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.235768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ccbbd3-2d85-4da8-bfa2-77855289ea9f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.243694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.244426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.244644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.244918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.245603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.248136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.249059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.250131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.289532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1035/2072] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:23 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:23.292927 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.319109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de480a71-833a-45f6-a6da-33bf39bec322 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.365199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb1646b-75b2-4225-9cde-0f9dd5dba14c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.370200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.370870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.371153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.371425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.372101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.374150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.378923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.379728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.380268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.380888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.383113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.399322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:23.403402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1036/2073] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:23 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:23.407735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.422558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646806b-25bf-485c-8d82-9ea168d39c50 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.428948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.432082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.432480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.432687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.433709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.436393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.451603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1037/2074] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:23.452835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.464655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c47f1c-d9c2-4eb2-857f-f24edf533f0b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.468266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.469974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.470121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d7fd9-96c0-494f-86e0-300e4e8b273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.470620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7fd9-96c0-494f-86e0-300e4e8b273e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.470991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7fd9-96c0-494f-86e0-300e4e8b273e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.471839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d7fd9-96c0-494f-86e0-300e4e8b273e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.472595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7fd9-96c0-494f-86e0-300e4e8b273e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.474530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d7fd9-96c0-494f-86e0-300e4e8b273e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.482409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1038/2075] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:23.489284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1038/2076] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:23.494674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.512301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc72df-99ab-495b-9c88-0e8693b4b3b3 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.519468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208613be-0925-4413-b86d-768969c68bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.520235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208613be-0925-4413-b86d-768969c68bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.520637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208613be-0925-4413-b86d-768969c68bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.520913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208613be-0925-4413-b86d-768969c68bf1 admin admin] PATH_INFO: `/v3/projects/875df2cf92db4ca0a05044abb2f9c915/users/a8ed32a8d58e480aaef3f4c8393973fb/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.541084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208613be-0925-4413-b86d-768969c68bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875df2cf92db4ca0a05044abb2f9c915, user_id=a8ed32a8d58e480aaef3f4c8393973fb, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.544837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208613be-0925-4413-b86d-768969c68bf1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.573753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1039/2077] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:23 2022] PUT /identity/v3/projects/875df2cf92db4ca0a05044abb2f9c915/users/a8ed32a8d58e480aaef3f4c8393973fb/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:23.590171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.591234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.592262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.612998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:23.621112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.621112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.621697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.649696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] MFA Rules not processed for user `9aa9db920f10441bb41a95feca5585f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:23.649696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.657311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] MFA Rules not processed for user `a8ed32a8d58e480aaef3f4c8393973fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:23.659614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:23.754910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1040/2078] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:23.781215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1039/2079] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:23.793333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:23.944218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67220a-942f-4c84-ac9e-07c29e30146f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:23.955732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126627d-7300-4c0a-8182-cc62c813f497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:23.956611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126627d-7300-4c0a-8182-cc62c813f497 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:23.957099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126627d-7300-4c0a-8182-cc62c813f497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:23.957732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126627d-7300-4c0a-8182-cc62c813f497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:23.971097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126627d-7300-4c0a-8182-cc62c813f497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:23.972571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126627d-7300-4c0a-8182-cc62c813f497 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:23.986413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1041/2080] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:26.926666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:27.022252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168fc9c-b223-4fba-adf7-0f528a87eedb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:27.034914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:27.035593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:27.035932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:27.036123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] PATH_INFO: `/v3/users/a8ed32a8d58e480aaef3f4c8393973fb` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:27.037508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8ed32a8d58e480aaef3f4c8393973fb)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:27.039471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:27.199244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8ed32a8d58e480aaef3f4c8393973fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:27.216177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8ed32a8d58e480aaef3f4c8393973fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:27.235138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8ed32a8d58e480aaef3f4c8393973fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:27.236358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8ed32a8d58e480aaef3f4c8393973fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:27.237284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8ed32a8d58e480aaef3f4c8393973fb'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:27.257377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1040/2081] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:26 2022] DELETE /identity/v3/users/a8ed32a8d58e480aaef3f4c8393973fb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:27.262447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:27.263033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:27.263033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:27.292330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:27.293509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:27.330104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:27.444367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1042/2082] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:27.465946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:27.467942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:27.493232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:27.617096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cd5d6-3a8d-4710-81d5-581f3ef5ede3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:27.627429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:27.629877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:27.630537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:27.631390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:27.657488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:27.659547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:27.682199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1041/2083] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:28.535837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:28.537369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:28.556463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609bd75-9b39-4954-ba6b-b004639b1da3 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:28.580709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:28.585879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.586176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.586454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] PATH_INFO: `/v3/projects/875df2cf92db4ca0a05044abb2f9c915` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.587838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875df2cf92db4ca0a05044abb2f9c915)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:28.589803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:28.592963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:28.595167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:28.678648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db670fcd-7ff3-47b3-9c6f-9f35c511fd86 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:28.688702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875df2cf92db4ca0a05044abb2f9c915', 'request_id': 'req-7a614adc-045d-4b24-be9f-9878e9c50ae4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:28.699739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875df2cf92db4ca0a05044abb2f9c915', 'request_id': 'req-7a614adc-045d-4b24-be9f-9878e9c50ae4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:28.707617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875df2cf92db4ca0a05044abb2f9c915', 'request_id': 'req-7a614adc-045d-4b24-be9f-9878e9c50ae4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:28.724049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] The token cache is being invalidate because project 875df2cf92db4ca0a05044abb2f9c915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:28.724379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:28.725196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7a614adc-045d-4b24-be9f-9878e9c50ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:28.728111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1043/2084] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:28 2022] DELETE /identity/v3/projects/875df2cf92db4ca0a05044abb2f9c915 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:28.736373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d082f9-9fb7-4205-89c4-115678e2660e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.736373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d082f9-9fb7-4205-89c4-115678e2660e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.736373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d082f9-9fb7-4205-89c4-115678e2660e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.748662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:28.749594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.749938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.750374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.752704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:28.770244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e3d082f9-9fb7-4205-89c4-115678e2660e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:28.771493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e3d082f9-9fb7-4205-89c4-115678e2660e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:28.871234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:28.872985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fe163-fc54-4057-a7ee-a2570d7c6d64 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:28.886013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1042/2085] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:28.888572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1044/2086] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:28.895426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231871-ba67-4b8d-8ce1-6674da1856f0 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.895712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231871-ba67-4b8d-8ce1-6674da1856f0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.895992 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231871-ba67-4b8d-8ce1-6674da1856f0 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.899953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1043/2087] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:42:28.907653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.907861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.907997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.908160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.908304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.909500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.935715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:28.936851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:28.950923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1045/2088] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:28.952137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:28.953431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:28.956852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:28.973336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04390c7-2a33-478a-bf7d-2ca74fc8f360 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:28.993615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:28.994245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:28.994524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:28.994796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:28.995575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:28.995881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:28.997718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.012996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:29.039097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1046/2089] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:29.040418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.043724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.076900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf24327-b316-4f13-a7f3-956a71a3c524 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.097394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.098342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.098789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.099214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] PATH_INFO: `/v3/users/d94d22c104a84a20b764557b2e4a94de` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.102111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94d22c104a84a20b764557b2e4a94de)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.104027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.172299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1044/2090] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:42:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:29.172813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.197105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:29.207907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3af18-8735-479c-925b-f627e534eb4e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.216486 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94d22c104a84a20b764557b2e4a94de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.217415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.218273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.218555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.218879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.219682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.223204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.233217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94d22c104a84a20b764557b2e4a94de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.249982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94d22c104a84a20b764557b2e4a94de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.252292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94d22c104a84a20b764557b2e4a94de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.278157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1045/2091] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:29 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:29.278597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94d22c104a84a20b764557b2e4a94de'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.279642 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.288084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.304352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1047/2092] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:29 2022] DELETE /identity/v3/users/d94d22c104a84a20b764557b2e4a94de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:29.305425 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.310104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.445019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b8e2e-7641-4a74-91e6-28ba9f05a289 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.445795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aab7b6-801f-4447-8cd1-26c4c1044c62 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.451988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.452744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.453148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.453651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.456879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.459545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.500620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1048/2093] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:29 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:29.502859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.517282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f033c93-7248-4a9a-bf0a-bbfcd84f969c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.524329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.525031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.525639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.525924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.526583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.528942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.543141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1049/2094] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:29.543781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.544027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.544409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.544915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.550257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.559262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.563329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f60a85-b5ea-47c0-bc19-0f4346168cb9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.570550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.571240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.571523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.571984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.573294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.575171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.587915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.592474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1050/2095] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:29.592768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa020-90d1-442f-910e-ac8a60c718e6 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.593820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.606086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce1159-69e2-4e09-af13-32b65b3a4c42 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.607899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1046/2096] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:29.611605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.612268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.612542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.612816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] PATH_INFO: `/v3/projects/e8c616055e79458ab3c250f008c32def/users/d61e7c4eb8d64e7e9860f6bebd9adca1/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.629919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c616055e79458ab3c250f008c32def, user_id=d61e7c4eb8d64e7e9860f6bebd9adca1, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.632476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.652887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1051/2097] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:29 2022] PUT /identity/v3/projects/e8c616055e79458ab3c250f008c32def/users/d61e7c4eb8d64e7e9860f6bebd9adca1/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:29.663444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.663847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.664278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.700791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] MFA Rules not processed for user `d61e7c4eb8d64e7e9860f6bebd9adca1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:29.702112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.720147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:29.729278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.731102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.793057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1047/2098] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:29.804137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:29.805836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:29.807923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.812482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946b732-1288-424f-9410-faa817b8e020 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.819734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.820527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.820804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.821078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] PATH_INFO: `/v3/projects/cd9a3aae514e4fe9aa76e37ea18a13b6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.822436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9a3aae514e4fe9aa76e37ea18a13b6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:29.824579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:29.878177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9a3aae514e4fe9aa76e37ea18a13b6', 'request_id': 'req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.882300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7284c-d726-4b46-95c1-f32a04f0ab0a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:29.886781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9a3aae514e4fe9aa76e37ea18a13b6', 'request_id': 'req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.893043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9a3aae514e4fe9aa76e37ea18a13b6', 'request_id': 'req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.905733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] The token cache is being invalidate because project cd9a3aae514e4fe9aa76e37ea18a13b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:29.906020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.906698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0ac9d86d-a6dc-4367-8047-dc9fc5167dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:29.909423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1052/2099] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:29 2022] DELETE /identity/v3/projects/cd9a3aae514e4fe9aa76e37ea18a13b6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:29.913119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1ed2-bc68-4aa2-a27b-dfec2953cb69 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.913434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1ed2-bc68-4aa2-a27b-dfec2953cb69 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.913714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1ed2-bc68-4aa2-a27b-dfec2953cb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.933782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-defb1ed2-bc68-4aa2-a27b-dfec2953cb69 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:29.934727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-defb1ed2-bc68-4aa2-a27b-dfec2953cb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:29.938082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:29.938696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:29.939153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:29.939434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:29.941878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:30.004787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1053/2100] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:30.006258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.006545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.006774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.006919 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.008344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.018841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1048/2101] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:30.026457 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:30.027491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:30.035668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1054/2102] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:30.039779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.051860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1542dc-c356-458a-982e-9bfcc4b85a70 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.057765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.060477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.060766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.061045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.061768 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:30.062059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.063694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.081558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1049/2103] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:30.087142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.096815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b49d91-45c7-479d-9d2c-4b67f60730af None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.103225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.103846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.104119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.104391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.105028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.106961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.149772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1055/2104] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:30 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:30.150377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.162303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5358d37-aed9-44a6-ad6b-62f6373f7e1c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.172399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:30.230969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.232095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.232382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.232663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.233303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.235383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.260207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1050/2105] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:30 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:30.264998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.275427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1991a-9719-4cf3-965a-57640a6118d2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.280446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.281145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.281459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.281816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.282590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.284727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.303277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1056/2106] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:30.304601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.315458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fac1ce-de0a-401d-a431-58210af14802 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.321242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e580f3-cc34-4011-8ea4-b6b805abdf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.321938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e580f3-cc34-4011-8ea4-b6b805abdf67 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.322217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e580f3-cc34-4011-8ea4-b6b805abdf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.322481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e580f3-cc34-4011-8ea4-b6b805abdf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.323113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e580f3-cc34-4011-8ea4-b6b805abdf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.324709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e580f3-cc34-4011-8ea4-b6b805abdf67 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.335649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1051/2107] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:30.340136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.352957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8cf13-23c5-4ac5-89be-29d1bf7d843e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.358337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.359094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.359441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.359780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] PATH_INFO: `/v3/projects/285729a18ef74524b1621a18b4630a6e/users/cc286b77186c4e928bec76099102c7d0/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.385285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285729a18ef74524b1621a18b4630a6e, user_id=cc286b77186c4e928bec76099102c7d0, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.388154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.420829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1057/2108] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:30 2022] PUT /identity/v3/projects/285729a18ef74524b1621a18b4630a6e/users/cc286b77186c4e928bec76099102c7d0/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:30.423630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.424778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.425385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.507101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] MFA Rules not processed for user `cc286b77186c4e928bec76099102c7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:30.508745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:30.600985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1052/2109] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:30.605601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.637800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:30.680616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e012b65-eb72-4307-a30a-11ba094cedb6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.685339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.685973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.686252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.686525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.687168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.689074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.719697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1058/2110] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:30 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:30.724531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.736693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a84924-c734-4f3c-9284-c7ba7451c98d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.803851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.804462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.804745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.805018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.805690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.807625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.833393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1053/2111] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:30 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:30.844129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.856766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7da72-8eea-4c10-b2c0-d9f2622eaa00 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.861995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.862744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.863045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.863315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.863968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.865772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.880739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1059/2112] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:30.885078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.896449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5324e4-dd90-4de6-bf10-34919a8f6fc4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:30.902039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:30.902929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:30.903205 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:30.903478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] PATH_INFO: `/v3/projects/1284048af1fb4472ac3f9bc62feda5e5/users/8338bed136154fd6bff1af1fb427e610/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:30.916072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:30.925644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1284048af1fb4472ac3f9bc62feda5e5, user_id=8338bed136154fd6bff1af1fb427e610, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:30.929601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:30.945140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1054/2113] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:30 2022] PUT /identity/v3/projects/1284048af1fb4472ac3f9bc62feda5e5/users/8338bed136154fd6bff1af1fb427e610/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:30.949263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:30.960396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994ce25-f367-4fde-9706-6c59413a5313 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:31.024578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3c97d-5ced-433f-899a-d7bea3ad1408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:31.025245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3c97d-5ced-433f-899a-d7bea3ad1408 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:31.025509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3c97d-5ced-433f-899a-d7bea3ad1408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:31.025780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3c97d-5ced-433f-899a-d7bea3ad1408 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:31.026433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3c97d-5ced-433f-899a-d7bea3ad1408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:31.028069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3c97d-5ced-433f-899a-d7bea3ad1408 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:31.039884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1060/2114] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:31.044149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:31.054855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e5cd3-27af-427c-8b58-4f4289c81774 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:31.059866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:31.060599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:31.060950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:31.061317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] PATH_INFO: `/v3/projects/1284048af1fb4472ac3f9bc62feda5e5/users/8338bed136154fd6bff1af1fb427e610/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:31.063449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1284048af1fb4472ac3f9bc62feda5e5, user_id=8338bed136154fd6bff1af1fb427e610, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:31.066840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:31.078311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1055/2115] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:31 2022] PUT /identity/v3/projects/1284048af1fb4472ac3f9bc62feda5e5/users/8338bed136154fd6bff1af1fb427e610/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:31.091565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:31.091861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:31.092141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:31.123134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] MFA Rules not processed for user `8338bed136154fd6bff1af1fb427e610`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:31.124518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:31.203177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1061/2116] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:31.215444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:31.217331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:31.281281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56247e-5808-4a1b-a385-93d2bf87ca1d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:31.284985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:31.285633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:31.285909 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:31.286184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:31.295593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:31.297047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:31.307947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1056/2117] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:31.356818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:31.359258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:31.374878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0890db-84b4-4e4b-974c-c6144cde0ce4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:31.379239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de55c-cb31-4384-ba36-75e48ba2f58c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:31.379841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de55c-cb31-4384-ba36-75e48ba2f58c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:31.380121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de55c-cb31-4384-ba36-75e48ba2f58c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:31.380391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de55c-cb31-4384-ba36-75e48ba2f58c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:31.395214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:31.442099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de55c-cb31-4384-ba36-75e48ba2f58c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:31.443546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de55c-cb31-4384-ba36-75e48ba2f58c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:31.453801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1062/2118] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:34.545964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:34.547377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:34.638011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1c3af-2aa9-42a3-9506-5ba8b20c91e5 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:34.644090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:34.644878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:34.645261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:34.645733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] PATH_INFO: `/v3/users/b730175359574ef489da7ead3ab3207f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:34.647158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b730175359574ef489da7ead3ab3207f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:34.649511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:34.707887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b730175359574ef489da7ead3ab3207f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:34.717714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b730175359574ef489da7ead3ab3207f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:34.744417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b730175359574ef489da7ead3ab3207f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:34.746035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b730175359574ef489da7ead3ab3207f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:34.746683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b730175359574ef489da7ead3ab3207f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:34.751384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:34.769434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1057/2119] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:34 2022] DELETE /identity/v3/users/b730175359574ef489da7ead3ab3207f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:34.774055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:34.774699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:34.774699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:34.797557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:34.797557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:34.913248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1063/2120] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:34.922674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:34.924912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:35.004234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44119fea-c8ab-4e6f-b91a-29aac15eebf7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:35.009089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:35.010873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:35.011171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:35.011464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:35.023793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:35.025544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:35.051126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1058/2121] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:35.281976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:35.283807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:35.308711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6424b-63ce-4ffc-9a9c-c4706229992e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:35.326555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:35.327274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:35.327577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:35.327874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] PATH_INFO: `/v3/users/cc286b77186c4e928bec76099102c7d0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:35.332611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc286b77186c4e928bec76099102c7d0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:35.334972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:35.473292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc286b77186c4e928bec76099102c7d0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.491274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:35.492028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:35.510762 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc286b77186c4e928bec76099102c7d0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.518150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cfa15-f34e-4153-bf21-aca71a3f278d service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:35.529919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:35.534439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc286b77186c4e928bec76099102c7d0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.537984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:35.538119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc286b77186c4e928bec76099102c7d0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.540560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:35.541011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] PATH_INFO: `/v3/projects/909c2d2502244c4bbb221eeebd9cd925` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:35.558186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909c2d2502244c4bbb221eeebd9cd925)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:35.565881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c43a550f-6934-4e3f-a65d-e6e0f318dfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc286b77186c4e928bec76099102c7d0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.566917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:35.587401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1064/2122] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:35 2022] DELETE /identity/v3/users/cc286b77186c4e928bec76099102c7d0 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:35.592937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:35.593239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:35.593783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:35.630296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:35.631725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:35.661721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909c2d2502244c4bbb221eeebd9cd925', 'request_id': 'req-e623a592-e99f-4c49-8912-8490cf17d2f9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.671234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909c2d2502244c4bbb221eeebd9cd925', 'request_id': 'req-e623a592-e99f-4c49-8912-8490cf17d2f9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.679242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909c2d2502244c4bbb221eeebd9cd925', 'request_id': 'req-e623a592-e99f-4c49-8912-8490cf17d2f9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.683119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:35.694382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] The token cache is being invalidate because project 909c2d2502244c4bbb221eeebd9cd925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:35.695155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.696104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.698343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1059/2123] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:35 2022] DELETE /identity/v3/projects/909c2d2502244c4bbb221eeebd9cd925 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:35.702266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:35.703801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:35.735989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1065/2124] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:35.746258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:35.747995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:35.782297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623a592-e99f-4c49-8912-8490cf17d2f9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:35.788751 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:35.789564 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:35.789851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:35.790129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] PATH_INFO: `/v3/users/eebc9d78176742b2b2524956755c737d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:35.791299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebc9d78176742b2b2524956755c737d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:35.793551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:35.817972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2a963-1aaa-41b1-b4a2-785d9d130c4a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:35.829051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:35.864663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebc9d78176742b2b2524956755c737d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.875390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebc9d78176742b2b2524956755c737d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.884096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:35.885068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:35.885427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:35.886097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:35.893081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebc9d78176742b2b2524956755c737d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.894618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebc9d78176742b2b2524956755c737d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.895578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebc9d78176742b2b2524956755c737d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:35.900734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:35.902320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:35.913613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1060/2125] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:35 2022] DELETE /identity/v3/users/eebc9d78176742b2b2524956755c737d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:35.915235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1066/2126] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:36.217755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:36.219403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:36.269835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:36.281460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a089f6b-e015-4c9e-814f-d8fd3f99f7e8 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:36.341766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39875740-5d12-4fac-905b-85c5727de4b8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:36.346713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:36.347464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.347916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.348138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] PATH_INFO: `/v3/projects/285729a18ef74524b1621a18b4630a6e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.349458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] RBAC: Authorizing `identity:delete_project(project_id=285729a18ef74524b1621a18b4630a6e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:36.351454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:36.366405 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:36.367040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.367310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.367577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] PATH_INFO: `/v3/projects/5ab36266851048e4a7d1570ec1403bee` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.368916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab36266851048e4a7d1570ec1403bee)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:36.370870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:36.413190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:36.428107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab36266851048e4a7d1570ec1403bee', 'request_id': 'req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.431724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285729a18ef74524b1621a18b4630a6e', 'request_id': 'req-6dc66844-d393-40bc-aa00-b2e213d7527f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.437845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab36266851048e4a7d1570ec1403bee', 'request_id': 'req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.442084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285729a18ef74524b1621a18b4630a6e', 'request_id': 'req-6dc66844-d393-40bc-aa00-b2e213d7527f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.447243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab36266851048e4a7d1570ec1403bee', 'request_id': 'req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.450396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285729a18ef74524b1621a18b4630a6e', 'request_id': 'req-6dc66844-d393-40bc-aa00-b2e213d7527f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.464838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] The token cache is being invalidate because project 5ab36266851048e4a7d1570ec1403bee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:36.464977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.478333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8f34f502-d713-4dad-97ae-1dbfd57cb9ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.480551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1067/2127] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:36 2022] DELETE /identity/v3/projects/5ab36266851048e4a7d1570ec1403bee => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:36.486958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ca4a-b646-44d7-9a6c-74562d8858e5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.487649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ca4a-b646-44d7-9a6c-74562d8858e5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.487932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9ca4a-b646-44d7-9a6c-74562d8858e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.491647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] The token cache is being invalidate because project 285729a18ef74524b1621a18b4630a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:36.492028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.492954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.494990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1061/2128] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:36 2022] DELETE /identity/v3/projects/285729a18ef74524b1621a18b4630a6e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:36.503198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:36.504613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:36.512332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a0a9ca4a-b646-44d7-9a6c-74562d8858e5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:36.514543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a0a9ca4a-b646-44d7-9a6c-74562d8858e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:36.559761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:36.617065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc66844-d393-40bc-aa00-b2e213d7527f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:36.623301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1068/2129] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:36.625830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:36.626707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.627076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.627412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] PATH_INFO: `/v3/users/8338bed136154fd6bff1af1fb427e610` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.631408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.631697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.631969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.633518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8338bed136154fd6bff1af1fb427e610)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:36.635741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:36.670891 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:36.672578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:36.689908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1069/2130] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:36.691360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:36.709326 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5760052-27a6-44a6-8442-71aec05e58bb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:36.715041 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:36.716230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.716547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.716852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.717662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:36.717956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:36.719592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:36.732732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8338bed136154fd6bff1af1fb427e610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.743043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8338bed136154fd6bff1af1fb427e610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.749199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1070/2131] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:36.750609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:36.763117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8338bed136154fd6bff1af1fb427e610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.765717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8338bed136154fd6bff1af1fb427e610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.766408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8338bed136154fd6bff1af1fb427e610'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:36.768377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f4826-0e15-431f-84ab-7fe21f3de8b9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:36.777658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:36.778650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:36.778983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:36.779310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:36.779991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:36.782583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:36.790200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1062/2132] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:36 2022] DELETE /identity/v3/users/8338bed136154fd6bff1af1fb427e610 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:36.837048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1071/2133] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:36 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:36.838858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:36.840298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:36.983587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cde583-3841-4177-bf8c-a3c130f339d1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.056147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:37.065609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.066439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.066899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.067482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.068469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.070853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.095895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1063/2134] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:36 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:37.099970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.110726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e5289-c9aa-4323-9c9d-95cc7c76fd28 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.116741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.118047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.118047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.118526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.119650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.121072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.137396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1072/2135] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:37.146758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.162729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.165137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.178788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548ae9c-dba2-4808-827e-b5c21d49ef52 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.180372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dcfdb-65d2-4649-914a-3ee581c3352b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.184136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.184966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.185322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.185484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.185637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] PATH_INFO: `/v3/projects/1284048af1fb4472ac3f9bc62feda5e5` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.186138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.186348 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.186623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.187060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1284048af1fb4472ac3f9bc62feda5e5)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.187271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.189002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.189923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.201698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1064/2136] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:37.205571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.218245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778fa18-007a-4b78-b1d7-7df6d47f55c3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.229644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eec1c6-098a-4f55-9584-5451d37a6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.230331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eec1c6-098a-4f55-9584-5451d37a6c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.230610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eec1c6-098a-4f55-9584-5451d37a6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.230921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eec1c6-098a-4f55-9584-5451d37a6c98 admin admin] PATH_INFO: `/v3/projects/47bdc5bf06824040bd83011e8e7fc24e/users/599ac882d68f489983c90d528af20d8b/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.253900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eec1c6-098a-4f55-9584-5451d37a6c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47bdc5bf06824040bd83011e8e7fc24e, user_id=599ac882d68f489983c90d528af20d8b, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.256610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eec1c6-098a-4f55-9584-5451d37a6c98 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.261060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1284048af1fb4472ac3f9bc62feda5e5', 'request_id': 'req-b01820f6-1f68-4507-82f8-e8e51064d774'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.270993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1284048af1fb4472ac3f9bc62feda5e5', 'request_id': 'req-b01820f6-1f68-4507-82f8-e8e51064d774'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.274161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1065/2137] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:37 2022] PUT /identity/v3/projects/47bdc5bf06824040bd83011e8e7fc24e/users/599ac882d68f489983c90d528af20d8b/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:37.287629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.287923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.288204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.290980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:37.293863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1284048af1fb4472ac3f9bc62feda5e5', 'request_id': 'req-b01820f6-1f68-4507-82f8-e8e51064d774'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.311599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] The token cache is being invalidate because project 1284048af1fb4472ac3f9bc62feda5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:37.311932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.312618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b01820f6-1f68-4507-82f8-e8e51064d774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.314254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1073/2138] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:37 2022] DELETE /identity/v3/projects/1284048af1fb4472ac3f9bc62feda5e5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:37.319004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bba58-0988-4756-bf4d-f399e6e51828 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.319290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bba58-0988-4756-bf4d-f399e6e51828 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.319571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bba58-0988-4756-bf4d-f399e6e51828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.323369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] MFA Rules not processed for user `599ac882d68f489983c90d528af20d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:37.325020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.344121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a95bba58-0988-4756-bf4d-f399e6e51828 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:37.346076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a95bba58-0988-4756-bf4d-f399e6e51828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.413813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1066/2139] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:37.433238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1074/2140] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:37.437615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.439750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.448542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.449223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.449692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.483438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:37.484985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.496108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1075/2141] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:37.500440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.509308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061aed4-e67d-4948-bb53-e828b6e79fbe None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.510568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb916d6-58ba-4d3f-b7cd-e4698b656daa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.513439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.514061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.514351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.514625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.516228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.517117 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.517965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.518238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.518896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:37.519331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.520973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.526076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.527530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.538374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1067/2142] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:37.541321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1076/2143] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:37.548818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.561262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.563118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.564589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012447e6-db82-4e97-848d-3e6c0dbf2851 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.574973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.575585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.575863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.576176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.576737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.577000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dfea5-545d-4bc8-8fc1-901a49224a18 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.578687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.583008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.583947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.584260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.584530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] PATH_INFO: `/v3/users/599ac882d68f489983c90d528af20d8b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.585920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=599ac882d68f489983c90d528af20d8b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.587836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.617802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1068/2144] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:37.622766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.657546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:37.661298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599ac882d68f489983c90d528af20d8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.672119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599ac882d68f489983c90d528af20d8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.683844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599ac882d68f489983c90d528af20d8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.685192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599ac882d68f489983c90d528af20d8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.702278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27324124-d120-4356-a54a-e95e91cf1ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599ac882d68f489983c90d528af20d8b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:37.706926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1252-bc99-4e1d-8f80-eb7a5a4e1548 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.709631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1077/2145] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:37 2022] DELETE /identity/v3/users/599ac882d68f489983c90d528af20d8b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:37.714090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.714497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.714953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.738215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:37.739413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.786136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.786754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.787031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.787302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.788000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.789901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:37.790310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.816377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1078/2146] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:37.817509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1069/2147] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:37.820211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.822038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.827066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.828826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:37.834935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0061ec3-9abb-42f7-8b12-ee4d66c9f54e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.841812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.842478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.842694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.842996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.843646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.845308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.877556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1079/2148] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:37.883347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.901582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bd2df-34c4-4fa4-82bd-561303574086 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.907719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.908638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.909138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.909514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.910295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.912033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.925312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25383ab-ee3d-4a50-9437-ba9b4006c69d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.928066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1080/2149] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:37.930229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5ecb8-5568-4750-bf0a-2cac2456dd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.930910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ecb8-5568-4750-bf0a-2cac2456dd47 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.931270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ecb8-5568-4750-bf0a-2cac2456dd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.931572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5ecb8-5568-4750-bf0a-2cac2456dd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.932934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:37.943866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ecb8-5568-4750-bf0a-2cac2456dd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.944631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4e556-55a3-4d82-8694-e9223962d3b9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:37.945631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5ecb8-5568-4750-bf0a-2cac2456dd47 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:37.950450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:37.952033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:37.952326 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:37.952978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] PATH_INFO: `/v3/projects/f236522fce014f5c8f5b2f679ec51c7b/users/14ef5a4ba69441bdbafb54a43272c066/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:37.956740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1070/2150] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:37.969657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f236522fce014f5c8f5b2f679ec51c7b, user_id=14ef5a4ba69441bdbafb54a43272c066, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:37.972366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.000332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.000627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.000907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.001437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1081/2151] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:37 2022] PUT /identity/v3/projects/f236522fce014f5c8f5b2f679ec51c7b/users/14ef5a4ba69441bdbafb54a43272c066/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:38.033059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] MFA Rules not processed for user `14ef5a4ba69441bdbafb54a43272c066`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:38.034333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:38.087536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:38.106780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1071/2152] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:38.111592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.204630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894c168-e32b-4488-838a-35d9ed34ce2c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.210001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.210602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.210884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.211151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.211802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.213738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.250862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1082/2153] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:38.256037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.267809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c5e5-cc3e-4cd0-a80c-07c289922412 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.351079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.352314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.352869 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.353322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.353559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.354664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.355490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:38.357192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.370638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707457ee-7139-46ee-8efe-b84dfc1159c2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.388551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1072/2154] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:38.392949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.400318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.401681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.402029 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.402348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] PATH_INFO: `/v3/projects/47bdc5bf06824040bd83011e8e7fc24e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.405149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=47bdc5bf06824040bd83011e8e7fc24e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.407709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.409301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c67aca-5255-4ea2-8168-cd0c4d08f56b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.414509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.415123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.415387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.415670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.416342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.417980 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.429168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1073/2155] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:38.433177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.446772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c1352-756c-4a52-ae12-63843a83e30a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.451922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.452590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.452807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.453130 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.453903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.456189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.465910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47bdc5bf06824040bd83011e8e7fc24e', 'request_id': 'req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:38.472266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1074/2156] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:38.475378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47bdc5bf06824040bd83011e8e7fc24e', 'request_id': 'req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:38.477632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.483338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47bdc5bf06824040bd83011e8e7fc24e', 'request_id': 'req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:38.487947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588bfed-fcc6-4ada-86a6-359e1371c987 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.496805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] The token cache is being invalidate because project 47bdc5bf06824040bd83011e8e7fc24e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:38.497092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:38.497819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f7f94-7a65-4d4f-ba67-e47e4e5cfaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:38.499349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1083/2157] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:38 2022] DELETE /identity/v3/projects/47bdc5bf06824040bd83011e8e7fc24e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:38.504675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2791b-7640-47e7-8f90-1455178bc67a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.504963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2791b-7640-47e7-8f90-1455178bc67a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.505279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2791b-7640-47e7-8f90-1455178bc67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.513971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:38.529385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fde2791b-7640-47e7-8f90-1455178bc67a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:38.532557 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fde2791b-7640-47e7-8f90-1455178bc67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:38.558074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663931c9-598c-451e-b4d2-cdeab0141b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.558831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663931c9-598c-451e-b4d2-cdeab0141b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.559182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663931c9-598c-451e-b4d2-cdeab0141b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.559569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663931c9-598c-451e-b4d2-cdeab0141b88 admin admin] PATH_INFO: `/v3/projects/0ecf1eef5fbb450b901673a4c06b252c/users/e088210f278441d6a77450f8617b6101/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.575848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663931c9-598c-451e-b4d2-cdeab0141b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ecf1eef5fbb450b901673a4c06b252c, user_id=e088210f278441d6a77450f8617b6101, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.578653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663931c9-598c-451e-b4d2-cdeab0141b88 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.592915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1075/2158] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:38 2022] PUT /identity/v3/projects/0ecf1eef5fbb450b901673a4c06b252c/users/e088210f278441d6a77450f8617b6101/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:38.604756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.605040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.605313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.609962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1084/2159] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:38.619709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.620058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.620344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.643664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] MFA Rules not processed for user `e088210f278441d6a77450f8617b6101`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:38.645411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:38.646335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:38.647980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:38.682783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:38.738624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1085/2160] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:38.741384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1076/2161] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:38.742947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.745826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.747458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:38.759719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c701fe4-1345-4b51-a893-1653a425dfe5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.766954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ffcd3-ac5d-4788-b533-25f7d02777db None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.770810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.771449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.773192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.773649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.776600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:38.776600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.776822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.776949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.777035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.777184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.777639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.778418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.781308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.796732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1086/2162] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:38.801609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.816263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb561-8dc1-4ea4-abb0-e780caed2896 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.821691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.822345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.822717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.823164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.823667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.825622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.835623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1077/2163] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/projects => generated 387 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:38.841421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.862308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1087/2164] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:38.867102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.926911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601cb6d-324a-44a4-b623-eb2cee914a78 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.942984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fb94f-12d3-4922-bed8-2136e9933806 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.947751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.948587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.948720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.948907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.949870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:38.951835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:38.972111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:38.979885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1088/2165] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:38.983822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:38.994609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423acffd-f1c6-4cd0-8d71-43e40cdcd76c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:38.995950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:38.996645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:38.997033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:38.997390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:38.998096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.000161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.002322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.002941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.003231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.003574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.004232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.005866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.017178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1089/2166] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:39.022124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.030254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1078/2167] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:38 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:39.031325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.032665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e680-0de2-4a1f-97a6-a93ea2f7920f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.039308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.039994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.040341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.040688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.041449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.043120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.043223 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43acc5-be17-431a-810a-6424da38f81a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.048239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.049016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.049278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.049582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.050284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.052070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.054837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1090/2168] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:39.059118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.072255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72076d-7c96-45e2-a8f4-7e97024454c5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.077765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1079/2169] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:39.078795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.081745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d02b88-13b5-4178-9537-452aefba09ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.082506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d02b88-13b5-4178-9537-452aefba09ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.082853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d02b88-13b5-4178-9537-452aefba09ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.083334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d02b88-13b5-4178-9537-452aefba09ef admin admin] PATH_INFO: `/v3/projects/fb852690787f46eab11d8ffc44d63c5e/users/2d95dd5400224b17aad2057752e66f8f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.090893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567771c-8dc2-4f34-9a54-4f4d6a476d96 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.097152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.097883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.098111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.098389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] PATH_INFO: `/v3/projects/dd427fa7c5694a37823a64ddd52de922/users/768ee0f2f9f745b0a2787e2b780ba8a8/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.104163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d02b88-13b5-4178-9537-452aefba09ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb852690787f46eab11d8ffc44d63c5e, user_id=2d95dd5400224b17aad2057752e66f8f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.107326 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d02b88-13b5-4178-9537-452aefba09ef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.124051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1091/2170] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:39 2022] PUT /identity/v3/projects/fb852690787f46eab11d8ffc44d63c5e/users/2d95dd5400224b17aad2057752e66f8f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:39.126140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd427fa7c5694a37823a64ddd52de922, user_id=768ee0f2f9f745b0a2787e2b780ba8a8, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.130174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.134382 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.134777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.135129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.153104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1080/2171] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:39 2022] PUT /identity/v3/projects/dd427fa7c5694a37823a64ddd52de922/users/768ee0f2f9f745b0a2787e2b780ba8a8/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:39.159995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.174633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:39.183412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] MFA Rules not processed for user `2d95dd5400224b17aad2057752e66f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:39.184930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:39.249125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e468f-ce2d-4bae-8f3d-682cfe27d2af admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.256182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.257200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.257806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.258347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.259413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.262268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.274301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1092/2172] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:39.282224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1081/2173] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:39.286069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.290470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.292074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:39.304773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daa122-0a32-4504-8f65-f5af0921b38b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.312261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a325b-024e-488f-ba27-0403f4f6d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.313019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a325b-024e-488f-ba27-0403f4f6d360 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.313438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a325b-024e-488f-ba27-0403f4f6d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.314857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a325b-024e-488f-ba27-0403f4f6d360 admin admin] PATH_INFO: `/v3/projects/dd427fa7c5694a37823a64ddd52de922/users/768ee0f2f9f745b0a2787e2b780ba8a8/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.317872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a325b-024e-488f-ba27-0403f4f6d360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd427fa7c5694a37823a64ddd52de922, user_id=768ee0f2f9f745b0a2787e2b780ba8a8, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.323724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a325b-024e-488f-ba27-0403f4f6d360 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.345092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1082/2174] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:39 2022] PUT /identity/v3/projects/dd427fa7c5694a37823a64ddd52de922/users/768ee0f2f9f745b0a2787e2b780ba8a8/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:39.358844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.359618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.360318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.377597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc637925-37a9-4dce-8b52-5ef73a37ef92 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.395859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] MFA Rules not processed for user `768ee0f2f9f745b0a2787e2b780ba8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:39.396631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:39.442688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.443310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.443615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.443882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.461535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:39.479610 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1083/2175] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:39.490599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:39.491994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:39.544284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.545800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.560840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1093/2176] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:39.569893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e361c6-cc32-4ec1-b42f-06eb59db48f5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:39.574047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:39.574651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:39.574934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:39.575204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:39.586946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:39.589396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:39.602914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1084/2177] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:40.306997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:40.318111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9168d-821c-4ec6-95c6-3cbc86dcc8bc service glance] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:40.322179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:40.322867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:40.323148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:40.323423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:40.325229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:40.387911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:40.389335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2dd51a-ea38-4067-a90c-2ef2f0a5a06e service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:40.398592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1094/2178] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:41.278654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:41.280069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:41.308656 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:41.350646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b49491-b849-40aa-b8ad-0a6d22b2f0b1 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:41.355467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:41.356108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:41.356391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:41.356663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] PATH_INFO: `/v3/users/d61e7c4eb8d64e7e9860f6bebd9adca1` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:41.357830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61e7c4eb8d64e7e9860f6bebd9adca1)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:41.359861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:41.412240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61e7c4eb8d64e7e9860f6bebd9adca1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:41.420129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61e7c4eb8d64e7e9860f6bebd9adca1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:41.432898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61e7c4eb8d64e7e9860f6bebd9adca1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:41.433733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61e7c4eb8d64e7e9860f6bebd9adca1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:41.434341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61e7c4eb8d64e7e9860f6bebd9adca1'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:41.451291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1085/2179] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:41 2022] DELETE /identity/v3/users/d61e7c4eb8d64e7e9860f6bebd9adca1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:41.455715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:41.456237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:41.456328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:41.476074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:41.477292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:41.564125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1095/2180] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:41.576232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:41.577877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:41.641178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72308727-a7aa-4dc8-a1a6-5731cda30031 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:41.645782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:41.646397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:41.646839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:41.647194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:41.659857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:41.661755 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:41.674162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1086/2181] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:41.979592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:41.981219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:41.995355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b74af-1072-45b9-bac1-c93918e4ab0d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:42.001917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:42.002841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:42.003082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:42.003381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] PATH_INFO: `/v3/projects/e8c616055e79458ab3c250f008c32def` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:42.004643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c616055e79458ab3c250f008c32def)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:42.007089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:42.066637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:42.068306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c616055e79458ab3c250f008c32def', 'request_id': 'req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:42.077715 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c616055e79458ab3c250f008c32def', 'request_id': 'req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:42.085300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c616055e79458ab3c250f008c32def', 'request_id': 'req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:42.097723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] The token cache is being invalidate because project e8c616055e79458ab3c250f008c32def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:42.098013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:42.098679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:42.100174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1096/2182] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:41 2022] DELETE /identity/v3/projects/e8c616055e79458ab3c250f008c32def => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:44.715706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:44.717137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:44.764643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:44.775753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6649a6fa-9d02-4f0d-8f25-31e55c5d745f service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:44.826630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:44.827237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:44.827519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:44.827791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:44.829619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:44.896811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:44.898497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340580-3141-4fd6-bf65-ffbb170ba297 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:44.909167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1087/2183] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:47.068556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:47.070011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:47.152640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8da4d-1a1d-46d4-baf9-7b65a8a8df19 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:47.158993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:47.159637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:47.159920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:47.160191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] PATH_INFO: `/v3/users/14ef5a4ba69441bdbafb54a43272c066` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:47.161329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ef5a4ba69441bdbafb54a43272c066)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:47.163408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:47.215848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ef5a4ba69441bdbafb54a43272c066'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.225250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ef5a4ba69441bdbafb54a43272c066'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.238921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ef5a4ba69441bdbafb54a43272c066'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.239873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ef5a4ba69441bdbafb54a43272c066'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.257400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ef5a4ba69441bdbafb54a43272c066'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.263980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1097/2184] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:47 2022] DELETE /identity/v3/users/14ef5a4ba69441bdbafb54a43272c066 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:47.268894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:47.269511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:47.269719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:47.289761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:47.291148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:47.367475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1088/2185] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:47.379990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:47.381738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:47.446808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2bc2ea-c301-43e9-9277-aacddb8092ed admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:47.450707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:47.451319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:47.451598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:47.451872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:47.462159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:47.463588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:47.467617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:47.475130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1098/2186] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:47.789949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:47.791371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:47.806853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7faf74-e554-4f71-a2f4-63d711fafb44 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:47.811347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:47.811983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:47.812262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:47.812532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] PATH_INFO: `/v3/projects/f236522fce014f5c8f5b2f679ec51c7b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:47.813713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f236522fce014f5c8f5b2f679ec51c7b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:47.815659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:47.870817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f236522fce014f5c8f5b2f679ec51c7b', 'request_id': 'req-48954cba-c0a4-441e-8d21-98405e2226c8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.872510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:47.880527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f236522fce014f5c8f5b2f679ec51c7b', 'request_id': 'req-48954cba-c0a4-441e-8d21-98405e2226c8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.887381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f236522fce014f5c8f5b2f679ec51c7b', 'request_id': 'req-48954cba-c0a4-441e-8d21-98405e2226c8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.898991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] The token cache is being invalidate because project f236522fce014f5c8f5b2f679ec51c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:47.899270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.899903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:47.901396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1089/2187] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:47 2022] DELETE /identity/v3/projects/f236522fce014f5c8f5b2f679ec51c7b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:47.905284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:47.915866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58328a42-4047-408d-a344-0dc8677db19b service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:47.976045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:47.976682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:47.976966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:47.977238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] PATH_INFO: `/v3/users/e088210f278441d6a77450f8617b6101` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:47.978450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e088210f278441d6a77450f8617b6101)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:47.980385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:48.028784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e088210f278441d6a77450f8617b6101'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.036552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e088210f278441d6a77450f8617b6101'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.044386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e088210f278441d6a77450f8617b6101'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.045077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e088210f278441d6a77450f8617b6101'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.057276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e088210f278441d6a77450f8617b6101'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.063226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1099/2188] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:47 2022] DELETE /identity/v3/users/e088210f278441d6a77450f8617b6101 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:48.368482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:48.371746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:48.395901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48954cba-c0a4-441e-8d21-98405e2226c8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:48.480039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:48.480772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:48.481051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:48.481422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] PATH_INFO: `/v3/projects/0ecf1eef5fbb450b901673a4c06b252c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:48.482707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ecf1eef5fbb450b901673a4c06b252c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:48.485008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:48.545253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ecf1eef5fbb450b901673a4c06b252c', 'request_id': 'req-f0b4add4-910f-407f-bb4d-a195cb096746'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.555328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ecf1eef5fbb450b901673a4c06b252c', 'request_id': 'req-f0b4add4-910f-407f-bb4d-a195cb096746'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.561429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ecf1eef5fbb450b901673a4c06b252c', 'request_id': 'req-f0b4add4-910f-407f-bb4d-a195cb096746'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.588785 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] The token cache is being invalidate because project 0ecf1eef5fbb450b901673a4c06b252c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:48.589087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.589796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.594396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1090/2189] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:48 2022] DELETE /identity/v3/projects/0ecf1eef5fbb450b901673a4c06b252c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:48.595517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:48.596993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:48.611074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada3ff2-b78e-4811-95f5-0bcd6c7fd8c0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:48.668067 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:48.668693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:48.668971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:48.669242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] PATH_INFO: `/v3/users/768ee0f2f9f745b0a2787e2b780ba8a8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:48.670394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768ee0f2f9f745b0a2787e2b780ba8a8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:48.672431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:48.694595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:48.719810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768ee0f2f9f745b0a2787e2b780ba8a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.727498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768ee0f2f9f745b0a2787e2b780ba8a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.737165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768ee0f2f9f745b0a2787e2b780ba8a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.738054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768ee0f2f9f745b0a2787e2b780ba8a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.750686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a4ae656e-5511-4f48-b380-592ac30c70b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768ee0f2f9f745b0a2787e2b780ba8a8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:48.757275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1100/2190] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:48 2022] DELETE /identity/v3/users/768ee0f2f9f745b0a2787e2b780ba8a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:49.039509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.040971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:49.057496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4add4-910f-407f-bb4d-a195cb096746 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.119996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.120955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.121342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.121649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] PATH_INFO: `/v3/projects/dd427fa7c5694a37823a64ddd52de922` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.123022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd427fa7c5694a37823a64ddd52de922)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.125298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.136383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:49.174919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd427fa7c5694a37823a64ddd52de922', 'request_id': 'req-2b0edc00-3336-443b-9d80-8d6a2959e513'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:49.183634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd427fa7c5694a37823a64ddd52de922', 'request_id': 'req-2b0edc00-3336-443b-9d80-8d6a2959e513'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:49.190360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd427fa7c5694a37823a64ddd52de922', 'request_id': 'req-2b0edc00-3336-443b-9d80-8d6a2959e513'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:49.202421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] The token cache is being invalidate because project dd427fa7c5694a37823a64ddd52de922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:49.202731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:49.203390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2b0edc00-3336-443b-9d80-8d6a2959e513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:49.204916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1091/2191] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:49 2022] DELETE /identity/v3/projects/dd427fa7c5694a37823a64ddd52de922 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:49.211183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.211502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.211777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.232099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:49.233312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:49.295100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1101/2192] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:49.305272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.305621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.305919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.326929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:49.328138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:49.336265 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1092/2193] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:49.340530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.350934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e5e9b-4088-4184-9f36-03e4cd6f45e4 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.359692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.360437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.361651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.362054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.362935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:49.365688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.367838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.380836 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1102/2194] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:42:49.385569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.395481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96f8a2-509d-46fb-b813-0b8d209f6e31 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.400048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.400639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.400943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.401211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.401898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.403789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.430481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1093/2195] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:49.435064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.445794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e7938-52a0-4641-971a-3c7ec305c117 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.520122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.520760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.521083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.521393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.522169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.524704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.551065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1103/2196] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:49.555034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.566007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07c27-5c17-48a3-95f4-2de49931fd9d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.570931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.571541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.571824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.572100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.572763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.574539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.586622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1094/2197] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:49.590773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.602034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dbb52-a3d4-4a52-b711-cab3f6f92839 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.607845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94027f45-101c-4266-98fe-0a6ce54c0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.608379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027f45-101c-4266-98fe-0a6ce54c0a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.608662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027f45-101c-4266-98fe-0a6ce54c0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.608935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94027f45-101c-4266-98fe-0a6ce54c0a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.609813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94027f45-101c-4266-98fe-0a6ce54c0a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.611956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94027f45-101c-4266-98fe-0a6ce54c0a09 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.624681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1104/2198] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:49.629830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.650905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006b1b4-6ff6-4b2d-8bc6-d6eaa8b91ccc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.654459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.655328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.655705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.656060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] PATH_INFO: `/v3/projects/390055d1adfc45778cf3c8b473efd2d0/users/c0e20004c5734fd8925baff989a9f642/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.679764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390055d1adfc45778cf3c8b473efd2d0, user_id=c0e20004c5734fd8925baff989a9f642, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.682915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.706245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1095/2199] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:49 2022] PUT /identity/v3/projects/390055d1adfc45778cf3c8b473efd2d0/users/c0e20004c5734fd8925baff989a9f642/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:49.723497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.723813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.724090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.731450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:49.766771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] MFA Rules not processed for user `c0e20004c5734fd8925baff989a9f642`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:49.768703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:49.837310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1105/2200] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:49.842326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.914760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e25f82e-b4de-4c98-8f9a-488f9ae2fd04 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:49.919549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:49.920225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:49.920509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:49.920944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:49.921660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:49.924112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:49.954470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1096/2201] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:49.959530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:49.970273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7108d3-eb77-4410-9779-53fc9663d175 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.032546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.033158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.033479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.033772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.034506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.036547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.058529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1106/2202] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:49 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:50.062597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.073596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4374994-32bf-4883-b479-648d3906b690 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.078260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.078857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.079150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.080003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.080647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.082287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.094501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1097/2203] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:50.099216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.109540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14056b6-8d4c-44e9-a43e-e713f0f586ad admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.114893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.115549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.115828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.116099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] PATH_INFO: `/v3/projects/0fe048174b934d73b60addd7a84ca7da/users/a7e51e1fff9243a8af7250621c178d1f/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.131704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe048174b934d73b60addd7a84ca7da, user_id=a7e51e1fff9243a8af7250621c178d1f, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.134392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.147703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1107/2204] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:50 2022] PUT /identity/v3/projects/0fe048174b934d73b60addd7a84ca7da/users/a7e51e1fff9243a8af7250621c178d1f/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:50.151645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.163068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da9e11-57d5-416c-aa7a-65c232905d9c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.168206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:50.223530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596643b-5749-40b6-b703-3348c3661c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.224138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596643b-5749-40b6-b703-3348c3661c8b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.224424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596643b-5749-40b6-b703-3348c3661c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.224697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596643b-5749-40b6-b703-3348c3661c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.225332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596643b-5749-40b6-b703-3348c3661c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.226966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6596643b-5749-40b6-b703-3348c3661c8b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.241243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1098/2205] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:50.242444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.253568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365c5d2-a095-4268-bcf5-88e882a8ef5b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.258175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.258854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.259135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.259406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] PATH_INFO: `/v3/projects/0fe048174b934d73b60addd7a84ca7da/users/a7e51e1fff9243a8af7250621c178d1f/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.261294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe048174b934d73b60addd7a84ca7da, user_id=a7e51e1fff9243a8af7250621c178d1f, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.263980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.274204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1108/2206] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:50 2022] PUT /identity/v3/projects/0fe048174b934d73b60addd7a84ca7da/users/a7e51e1fff9243a8af7250621c178d1f/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:50.284619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.284912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.285189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.317650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] MFA Rules not processed for user `a7e51e1fff9243a8af7250621c178d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:50.328557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:50.399591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1099/2207] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:50.410570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.412291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:50.469103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:50.481080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006652a4-83fa-426d-82f0-3c47c3623b5c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.484392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.485001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.485278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.486105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.495930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.497379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.507376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1109/2208] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:50.815184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.816630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:50.905501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199847ca-13fc-4fd0-bacc-758233652f96 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.910054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.910675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.910948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.911212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] PATH_INFO: `/v3/users/d5b07a45a49b4137827caaa7c4eb46c9` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.912325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b07a45a49b4137827caaa7c4eb46c9)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.914272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.953838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:50.957438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:50.967924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f9453-627f-4374-b6cb-2deed0240427 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:50.969094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b07a45a49b4137827caaa7c4eb46c9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:50.973138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:50.973757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:50.974036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:50.974308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] PATH_INFO: `/v3/users/c0e20004c5734fd8925baff989a9f642` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:50.975466 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e20004c5734fd8925baff989a9f642)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:50.976394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b07a45a49b4137827caaa7c4eb46c9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:50.977463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:50.989060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b07a45a49b4137827caaa7c4eb46c9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:50.989764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b07a45a49b4137827caaa7c4eb46c9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:50.990368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55e5bfb8-69c4-47ff-9a3a-826bfdefefe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b07a45a49b4137827caaa7c4eb46c9'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.005825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1100/2209] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:50 2022] DELETE /identity/v3/users/d5b07a45a49b4137827caaa7c4eb46c9 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:51.010411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.010760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.011090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.031134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:51.032366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.032508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e20004c5734fd8925baff989a9f642'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.039706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e20004c5734fd8925baff989a9f642'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.047551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e20004c5734fd8925baff989a9f642'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.048906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e20004c5734fd8925baff989a9f642'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.067249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-103cc512-b377-4d95-b941-e258de5a5f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e20004c5734fd8925baff989a9f642'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.078299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1110/2210] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:50 2022] DELETE /identity/v3/users/c0e20004c5734fd8925baff989a9f642 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:51.082319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.082604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.082882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.100633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1101/2211] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:51.102166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:51.103363 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.111162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:51.112613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.174396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1111/2212] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:51.179448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb0162-a43b-4e21-a740-1b1b3c95c64a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:51.185311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:51.234773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:51.235289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.236084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.236349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.246269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:51.247705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:51.250834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb72d4be-e479-43cb-9967-0803ebcf3225 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:51.255135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:51.255740 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.256021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.256929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.257843 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1102/2213] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:51.267015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:51.268506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:51.279009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1112/2214] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:51.662941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:51.664951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.679108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a596dde-708a-4e11-b8fe-3271befcc1f5 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:51.683908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:51.684535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.684812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.685088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] PATH_INFO: `/v3/projects/d979f351dbd142b2b1d5c0c05890be90` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.686429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d979f351dbd142b2b1d5c0c05890be90)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:51.688388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:51.691702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:51.703667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:51.707965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.717573 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:51.728276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4bb71-8ad7-4d68-ba52-98cc1387c113 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:51.738377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:51.739060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.739347 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.739695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] PATH_INFO: `/v3/projects/390055d1adfc45778cf3c8b473efd2d0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.740862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=390055d1adfc45778cf3c8b473efd2d0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:51.742847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:51.754955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd979f351dbd142b2b1d5c0c05890be90', 'request_id': 'req-050440d2-bf91-4715-b062-bcf330bb2c77'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.765408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd979f351dbd142b2b1d5c0c05890be90', 'request_id': 'req-050440d2-bf91-4715-b062-bcf330bb2c77'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.775247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd979f351dbd142b2b1d5c0c05890be90', 'request_id': 'req-050440d2-bf91-4715-b062-bcf330bb2c77'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.790748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] The token cache is being invalidate because project d979f351dbd142b2b1d5c0c05890be90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:51.791039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.791737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-050440d2-bf91-4715-b062-bcf330bb2c77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.793787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1103/2215] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:51 2022] DELETE /identity/v3/projects/d979f351dbd142b2b1d5c0c05890be90 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:51.798577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c1a0d-3f2c-4fb3-96a4-2195236fbf75 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.798894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c1a0d-3f2c-4fb3-96a4-2195236fbf75 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.799125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c1a0d-3f2c-4fb3-96a4-2195236fbf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.804453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390055d1adfc45778cf3c8b473efd2d0', 'request_id': 'req-646864ca-d315-43c2-8f92-5c411e0ae7fe'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.818911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390055d1adfc45778cf3c8b473efd2d0', 'request_id': 'req-646864ca-d315-43c2-8f92-5c411e0ae7fe'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.823607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-478c1a0d-3f2c-4fb3-96a4-2195236fbf75 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:51.824842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-478c1a0d-3f2c-4fb3-96a4-2195236fbf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.826051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390055d1adfc45778cf3c8b473efd2d0', 'request_id': 'req-646864ca-d315-43c2-8f92-5c411e0ae7fe'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.839204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] The token cache is being invalidate because project 390055d1adfc45778cf3c8b473efd2d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:51.839685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.840604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:51.842132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1113/2216] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:51 2022] DELETE /identity/v3/projects/390055d1adfc45778cf3c8b473efd2d0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:51.846802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:51.848700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.891587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1104/2217] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:51.901021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.901324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.901636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.923482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:51.924784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:51.927352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646864ca-d315-43c2-8f92-5c411e0ae7fe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:51.932956 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1105/2218] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:51.936460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:51.936460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.936460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.936460 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] PATH_INFO: `/v3/users/a7e51e1fff9243a8af7250621c178d1f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.936796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e51e1fff9243a8af7250621c178d1f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:51.937534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:51.938259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:51.951096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39a71b-1267-4cf3-a14a-aaf74379de4c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:51.959994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:51.963999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:51.963999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:51.963999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:51.963999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:51.963999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:51.964446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:51.982600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1106/2219] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:42:51.986766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.008673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8028-5a38-4ced-9678-6cef77b7499f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.015051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.015775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.016057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.016332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.017669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.019648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.027795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e51e1fff9243a8af7250621c178d1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.035873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e51e1fff9243a8af7250621c178d1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.043991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e51e1fff9243a8af7250621c178d1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.045231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e51e1fff9243a8af7250621c178d1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.054824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1107/2220] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:51 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:42:52.056646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.059191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.062876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e51e1fff9243a8af7250621c178d1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.071389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1114/2221] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:51 2022] DELETE /identity/v3/users/a7e51e1fff9243a8af7250621c178d1f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:52.126971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:52.143067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b715-abc1-4983-b6d4-e51bbcc8890a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.206497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.207105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.207384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.207651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.208279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.210506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.232534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1108/2222] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:52.236803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.250698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:52.256003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19dcbdf-afb7-464b-b779-ca9c6effebf4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.262426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.263087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.263528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.263958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.264655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.266440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.286872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1115/2223] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:52.287120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.295862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133587-3020-42aa-a246-02ab9050fbbb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.300907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a990f-027d-4d8f-8ae7-8347a08fc1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.302059 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a990f-027d-4d8f-8ae7-8347a08fc1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.302344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a990f-027d-4d8f-8ae7-8347a08fc1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.302620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a990f-027d-4d8f-8ae7-8347a08fc1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.303306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a990f-027d-4d8f-8ae7-8347a08fc1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.304978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a990f-027d-4d8f-8ae7-8347a08fc1b3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.319771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1109/2224] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:42:52.321691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.333863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9a2d7-5fe9-4aac-a4b8-1c14615a09d7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.339493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.340365 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.340711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.341200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] PATH_INFO: `/v3/projects/65025d256f5d4a5abfef2383fdefd943/users/dff7415579ca4eddb2c7c11a7f603641/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.357025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65025d256f5d4a5abfef2383fdefd943, user_id=dff7415579ca4eddb2c7c11a7f603641, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.359710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.378989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1116/2225] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:52 2022] PUT /identity/v3/projects/65025d256f5d4a5abfef2383fdefd943/users/dff7415579ca4eddb2c7c11a7f603641/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:52.390020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.390303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.390582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.398819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.400950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.436925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] MFA Rules not processed for user `dff7415579ca4eddb2c7c11a7f603641`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:52.438298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.479091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d5483-4c51-4929-b4c2-c4bc15c78793 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.483707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.484345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.484625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.484896 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] PATH_INFO: `/v3/projects/0fe048174b934d73b60addd7a84ca7da` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.486547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe048174b934d73b60addd7a84ca7da)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.488451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.511547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1110/2226] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:52.524944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.526705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.538418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe048174b934d73b60addd7a84ca7da', 'request_id': 'req-ad4d30e6-e083-495b-a639-e89f480265b6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.546737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe048174b934d73b60addd7a84ca7da', 'request_id': 'req-ad4d30e6-e083-495b-a639-e89f480265b6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.553863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe048174b934d73b60addd7a84ca7da', 'request_id': 'req-ad4d30e6-e083-495b-a639-e89f480265b6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.567128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] The token cache is being invalidate because project 0fe048174b934d73b60addd7a84ca7da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:52.567424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.568200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ad4d30e6-e083-495b-a639-e89f480265b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.570016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1117/2227] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:52 2022] DELETE /identity/v3/projects/0fe048174b934d73b60addd7a84ca7da => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:52.575614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93a77c-b0e2-4401-bbf5-261a37bc189c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.575952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93a77c-b0e2-4401-bbf5-261a37bc189c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.576229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93a77c-b0e2-4401-bbf5-261a37bc189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.592518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960ad0a-edc5-4473-8311-0a66e88503a0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.596991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1f93a77c-b0e2-4401-bbf5-261a37bc189c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:52.598233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1f93a77c-b0e2-4401-bbf5-261a37bc189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.612344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:52.648241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.648857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.649131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.649550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.651737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.653809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:52.671161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1118/2228] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:52.673822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.674119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.674391 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.694443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:52.695651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.703578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1119/2229] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:52.707857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.717272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4824a-170b-465f-a999-c0ec40946635 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.718176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.719831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.722536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.725439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.725439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.725439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.725439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:42:52.725439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.727257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.729934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1111/2230] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:52.742334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1120/2231] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:42:52.747033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.760056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.761844 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.762044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643805ba-83ef-446b-8668-b834300d050f service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.766859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.767444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.767720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.767989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.768818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.770688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.774781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd91643-f0f8-48c4-aa13-c72d3ba35bd2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.779529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.781948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.781948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.781948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] PATH_INFO: `/v3/users/dff7415579ca4eddb2c7c11a7f603641` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.781948 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff7415579ca4eddb2c7c11a7f603641)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.784362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.803210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1112/2232] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:52.804197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.838865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff7415579ca4eddb2c7c11a7f603641'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.849469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff7415579ca4eddb2c7c11a7f603641'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.857137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff7415579ca4eddb2c7c11a7f603641'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.857880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff7415579ca4eddb2c7c11a7f603641'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.873106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-59d78e71-ad9d-4a3d-ab26-240a9dada31c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff7415579ca4eddb2c7c11a7f603641'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:52.873984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b3e54-8dfe-4b47-b3d8-c5196b2f6132 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.880383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:52.880977 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.881273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.881503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1121/2233] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:42:52 2022] DELETE /identity/v3/users/dff7415579ca4eddb2c7c11a7f603641 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:42:52.884349 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.885026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:52.886005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:52.886292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:52.886569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:52.887171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:52.911780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:52.913241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.913380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1113/2234] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:42:52.917204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.921780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:52.937165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2407ef1-5ae7-4f98-aab7-dfbf5030ca53 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:52.981442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:52.983433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1122/2235] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:42:52.993990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:52.995491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:53.001415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:53.002031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.002313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.002587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.003235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:53.004853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:53.018016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1114/2236] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:53.019065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:53.029532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519e74f-0168-42c3-b46b-d1dadb49c50d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:53.034814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:53.035385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.035661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.035926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.036546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:53.038170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:53.057289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ffcbfa-6158-4020-a09c-9b56c8eba613 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:53.057855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1115/2237] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:42:53.058805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:53.061655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f88220-6e2c-4c58-89fd-fad8c54a17e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:53.062267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f88220-6e2c-4c58-89fd-fad8c54a17e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.062580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f88220-6e2c-4c58-89fd-fad8c54a17e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.062851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f88220-6e2c-4c58-89fd-fad8c54a17e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.070221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd46e17-d190-43a4-9f75-ff272468e282 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:53.074418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:42:53.077190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:53.077337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f88220-6e2c-4c58-89fd-fad8c54a17e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:53.078236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.078621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.078903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] PATH_INFO: `/v3/projects/9aed516c4e6b4264bf579ecd9b054855/users/1b51cd872d2b45f5b39930f73029d7d8/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.079287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f88220-6e2c-4c58-89fd-fad8c54a17e3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:53.093988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1123/2238] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:42:53.098492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aed516c4e6b4264bf579ecd9b054855, user_id=1b51cd872d2b45f5b39930f73029d7d8, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:53.101190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:53.115580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1116/2239] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:42:53 2022] PUT /identity/v3/projects/9aed516c4e6b4264bf579ecd9b054855/users/1b51cd872d2b45f5b39930f73029d7d8/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:42:53.132424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.132723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.132977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.164281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] MFA Rules not processed for user `1b51cd872d2b45f5b39930f73029d7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:42:53.165211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:53.243273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1124/2240] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:42:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:42:53.255568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:53.257832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:53.339617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a341370-af61-4494-9d9d-cfa828a070f9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:53.344769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:53.346037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.346366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.346652 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.360306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:53.364178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:53.375529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1117/2241] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:42:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:42:53.479040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:42:53.480702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:42:53.564180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e19db-b9e9-4ddc-aa19-c9b667efad0f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:42:53.570286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:42:53.571120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:42:53.571567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:42:53.571845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] PATH_INFO: `/v3/projects/65025d256f5d4a5abfef2383fdefd943` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:42:53.573120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65025d256f5d4a5abfef2383fdefd943)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:42:53.575455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:42:53.633939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65025d256f5d4a5abfef2383fdefd943', 'request_id': 'req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:53.650297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65025d256f5d4a5abfef2383fdefd943', 'request_id': 'req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:53.662721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65025d256f5d4a5abfef2383fdefd943', 'request_id': 'req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:53.678015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] The token cache is being invalidate because project 65025d256f5d4a5abfef2383fdefd943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:42:53.678339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:53.679138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d1557cf3-fee4-4a66-a8c8-a76e50c2f501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:42:53.681013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1125/2242] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:42:53 2022] DELETE /identity/v3/projects/65025d256f5d4a5abfef2383fdefd943 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:03.369481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:03.673497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:06.089144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:06.099636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2692d9c-d128-4c79-acd0-1eaadfd9a436 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:06.159255 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:06.159879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:06.160152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:06.160447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] PATH_INFO: `/v3/users/1b51cd872d2b45f5b39930f73029d7d8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:06.161582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b51cd872d2b45f5b39930f73029d7d8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:06.163513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:06.216990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b51cd872d2b45f5b39930f73029d7d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.225741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b51cd872d2b45f5b39930f73029d7d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.239838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b51cd872d2b45f5b39930f73029d7d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.240583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b51cd872d2b45f5b39930f73029d7d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.241232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b51cd872d2b45f5b39930f73029d7d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.256627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1118/2243] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:06 2022] DELETE /identity/v3/users/1b51cd872d2b45f5b39930f73029d7d8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:06.261636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:06.262211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:06.262354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:06.282772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:06.283993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:06.354991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1126/2244] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:06.365342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:06.366941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:06.427001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9e3e-c847-44b9-af00-2588aaace7c6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:06.430687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f07031-df2e-4e88-8b00-eafe2f31a8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:06.431291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07031-df2e-4e88-8b00-eafe2f31a8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:06.431569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07031-df2e-4e88-8b00-eafe2f31a8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:06.431848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f07031-df2e-4e88-8b00-eafe2f31a8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:06.441735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f07031-df2e-4e88-8b00-eafe2f31a8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:06.443203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f07031-df2e-4e88-8b00-eafe2f31a8c7 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:06.453393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1119/2245] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:06.819518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:06.821912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:06.850038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db933d-f11c-4b88-bfe7-c877786a88fe None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:06.850038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:06.850038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:06.850038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:06.850695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] PATH_INFO: `/v3/projects/9aed516c4e6b4264bf579ecd9b054855` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:06.850695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aed516c4e6b4264bf579ecd9b054855)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:06.850695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:06.900640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aed516c4e6b4264bf579ecd9b054855', 'request_id': 'req-ea014c33-d179-4382-9c6a-829226cacff9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.913297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aed516c4e6b4264bf579ecd9b054855', 'request_id': 'req-ea014c33-d179-4382-9c6a-829226cacff9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.922125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aed516c4e6b4264bf579ecd9b054855', 'request_id': 'req-ea014c33-d179-4382-9c6a-829226cacff9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.934805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] The token cache is being invalidate because project 9aed516c4e6b4264bf579ecd9b054855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:06.935105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.935878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-ea014c33-d179-4382-9c6a-829226cacff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:06.937579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1127/2246] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:06 2022] DELETE /identity/v3/projects/9aed516c4e6b4264bf579ecd9b054855 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:06.942657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:06.942952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:06.943253 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:06.963127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:06.964347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:06.989042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:07.040548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1120/2247] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:07.049931 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.050218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.050492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.071630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:07.072853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:07.081150 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1128/2248] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:07.093546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.095996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b654c93-44ca-48c3-9c37-1994bafc1874 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.100520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.101116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.101424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.101691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.102358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:43:07.102654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.104237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.116395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1121/2249] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:43:07.121122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.130918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81380781-ec79-4e7f-b8a5-0772d18bb783 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.135639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.136234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.136529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.136798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.137465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.139388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.171066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1129/2250] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:07.175203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.186585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac1bf4-0145-4095-8ce2-992dfdaaa8a4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.260617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.261291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.261761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.262260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.263079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.265113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.288313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1122/2251] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:07.292659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.304766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3c4db-32bf-4455-bac1-da783a6f4bc3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.312244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.313307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.313875 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.314419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.315583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.318700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.341372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1130/2252] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:07.342592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.353538 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57156b-84ba-4c4f-b72b-09235eefed58 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.358280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609d64-881e-4d90-b7ad-d9df98e93429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.358888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609d64-881e-4d90-b7ad-d9df98e93429 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.359167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609d64-881e-4d90-b7ad-d9df98e93429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.359439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609d64-881e-4d90-b7ad-d9df98e93429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.360730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609d64-881e-4d90-b7ad-d9df98e93429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.362375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609d64-881e-4d90-b7ad-d9df98e93429 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.379467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1123/2253] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:07.383720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.395011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d0dd5-bd2f-4b6e-9d97-c7cfe025543a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.400324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.401098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.401484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.401868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] PATH_INFO: `/v3/projects/291173a2b94747319d79014f978faae4/users/bb25f1db6b984e808bd0d74651cad14b/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.418661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=291173a2b94747319d79014f978faae4, user_id=bb25f1db6b984e808bd0d74651cad14b, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.421512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.435560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1131/2254] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:07 2022] PUT /identity/v3/projects/291173a2b94747319d79014f978faae4/users/bb25f1db6b984e808bd0d74651cad14b/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:07.446313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.446601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.446877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.476305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] MFA Rules not processed for user `bb25f1db6b984e808bd0d74651cad14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:07.477708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:07.554556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1124/2255] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:07.559088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.580514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:07.626099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4ef09-5ea8-46f2-ba6c-62f807ce00fb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.630843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.631485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.631760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.632031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.632664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.634600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.662944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1132/2256] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:07.667289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.678342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bd7cf-eb75-4128-b89d-9a3d684cb2dc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.691462 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:07.742282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.742893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.743295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.743578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.744327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.746471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.769867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1125/2257] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:07.777164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.788595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc9493-390b-40c2-8104-88ffa125e54e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.793484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.794225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.794569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.794908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.795661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.797954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.808951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1133/2258] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:07.813692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.823508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983c839-5c30-4ec9-acb8-ec9bce924db1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.828232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1b0ba-c427-4f9e-9d1d-6e9d60da5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.829096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b0ba-c427-4f9e-9d1d-6e9d60da5709 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.829400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b0ba-c427-4f9e-9d1d-6e9d60da5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.829673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1b0ba-c427-4f9e-9d1d-6e9d60da5709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.830321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1b0ba-c427-4f9e-9d1d-6e9d60da5709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.831923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d1b0ba-c427-4f9e-9d1d-6e9d60da5709 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.850539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1126/2259] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:07.855469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:07.874251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731028c-d785-4042-abc0-ceda4ee90a39 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:07.887798 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:07.888731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.889165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.889638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] PATH_INFO: `/v3/projects/25f69a0c05174b54871cb0d7e38ee151/users/9fd4460f4c93466ea58e17c14a5dd5d8/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.911190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f69a0c05174b54871cb0d7e38ee151, user_id=9fd4460f4c93466ea58e17c14a5dd5d8, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:07.914133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:07.928327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1134/2260] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:07 2022] PUT /identity/v3/projects/25f69a0c05174b54871cb0d7e38ee151/users/9fd4460f4c93466ea58e17c14a5dd5d8/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:07.939345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:07.939635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:07.939940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:07.971694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] MFA Rules not processed for user `9fd4460f4c93466ea58e17c14a5dd5d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:07.973008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.046026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1127/2261] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:08.050508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.122841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.124361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.128476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b28fb-7bc9-47c5-9642-b5a87c602588 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.133086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.133727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.134010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.134281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.134920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.136817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.138012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b6ec5-2d4d-4af3-831b-752b643e1bdd None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.143273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.143906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.144182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.144448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] PATH_INFO: `/v3/users/2d95dd5400224b17aad2057752e66f8f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.145617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d95dd5400224b17aad2057752e66f8f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.147563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.184093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1135/2262] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:08 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:08.185264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.212583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d95dd5400224b17aad2057752e66f8f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:08.221019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d95dd5400224b17aad2057752e66f8f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:08.234104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d95dd5400224b17aad2057752e66f8f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:08.234906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d95dd5400224b17aad2057752e66f8f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:08.235558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3db7d9de-4334-4f4d-8be1-85f9c282a579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d95dd5400224b17aad2057752e66f8f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:08.245626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:08.250859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:08.255400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1128/2263] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:08 2022] DELETE /identity/v3/users/2d95dd5400224b17aad2057752e66f8f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:43:08.260445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dd8c2-adb6-4b52-b01f-1a78b0415368 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.260659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.262046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.262463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.283654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:08.285144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.321403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.321980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.322207 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.322497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.323103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.325021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.350301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1136/2264] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:08 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:43:08.350504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1129/2265] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:08.351354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.353016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.359169 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.361189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.366049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8104c-4422-4e6b-842f-cda6c8d6fdfe admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.371372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.371979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.372252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.372519 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.373158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.374800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.388601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1137/2266] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:08.390335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.401675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911ea2-4c57-4392-a623-5f5add08fee5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.406928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e90d6-9128-420a-b477-2bddcad03625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.407640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e90d6-9128-420a-b477-2bddcad03625 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.407963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e90d6-9128-420a-b477-2bddcad03625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.408264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e90d6-9128-420a-b477-2bddcad03625 admin admin] PATH_INFO: `/v3/projects/8ff01258e94c4d6a90f1099b8aa2ff78/users/01868cdd9d854e588e23c2a8853f35fb/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.422137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432176d5-256e-4f07-986c-259508fca7e6 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.424797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e90d6-9128-420a-b477-2bddcad03625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff01258e94c4d6a90f1099b8aa2ff78, user_id=01868cdd9d854e588e23c2a8853f35fb, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.426828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.427438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.427546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e90d6-9128-420a-b477-2bddcad03625 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.427718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.427996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.437953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.439438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.441474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1138/2267] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:08 2022] PUT /identity/v3/projects/8ff01258e94c4d6a90f1099b8aa2ff78/users/01868cdd9d854e588e23c2a8853f35fb/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:43:08.443061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.444335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.444335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.452559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1130/2268] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:43:08.453924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.463662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4635b39-ca02-4dc0-b380-c720de5613bb service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.466409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:08.467872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.539206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.539819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.540097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.540362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.541037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.542686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.543957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1139/2269] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:08.554933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1131/2270] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:08.559241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.568419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.571196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.573153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1490f4e-09bf-44ea-bb69-a222802a7c49 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.578703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c5c76-d5ba-485c-a3a8-a0891a03d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.579381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5c76-d5ba-485c-a3a8-a0891a03d5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.579659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5c76-d5ba-485c-a3a8-a0891a03d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.579932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c5c76-d5ba-485c-a3a8-a0891a03d5a8 admin admin] PATH_INFO: `/v3/projects/8ff01258e94c4d6a90f1099b8aa2ff78/users/01868cdd9d854e588e23c2a8853f35fb/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.582445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c5c76-d5ba-485c-a3a8-a0891a03d5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff01258e94c4d6a90f1099b8aa2ff78, user_id=01868cdd9d854e588e23c2a8853f35fb, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.586716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c5c76-d5ba-485c-a3a8-a0891a03d5a8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.600006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1140/2271] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:08 2022] PUT /identity/v3/projects/8ff01258e94c4d6a90f1099b8aa2ff78/users/01868cdd9d854e588e23c2a8853f35fb/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:08.613173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.613540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.614104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.647851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:08.653614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] MFA Rules not processed for user `01868cdd9d854e588e23c2a8853f35fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:08.655274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.693514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed4a4c-c303-45ff-be5d-6aed3a4c41ce admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.698692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:08.771955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1141/2272] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:08.780752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.783705 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.810606 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.811389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.811773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.812170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.853713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa962f9-365e-401d-b567-375ee6cec8ea None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.858149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.858772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.859050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.859323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.861751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.925698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.927600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.940816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1132/2273] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:43:08.941883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:08.943831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:08.946717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.948307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5cb51-dc3b-46c4-afa3-44cfcd87c3e1 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:08.962942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed5dc6-f12a-43a3-a79e-3f94a56ddbf2 service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:08.970914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:08.971122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1142/2274] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:43:08.972554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:08.973026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:08.973552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] PATH_INFO: `/v3/projects/fb852690787f46eab11d8ffc44d63c5e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:08.976727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb852690787f46eab11d8ffc44d63c5e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:08.979135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.051439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb852690787f46eab11d8ffc44d63c5e', 'request_id': 'req-8350ab4d-9013-471e-bd05-5c099d1bf96c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:09.061057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb852690787f46eab11d8ffc44d63c5e', 'request_id': 'req-8350ab4d-9013-471e-bd05-5c099d1bf96c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:09.071049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:09.073039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb852690787f46eab11d8ffc44d63c5e', 'request_id': 'req-8350ab4d-9013-471e-bd05-5c099d1bf96c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:09.107887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] The token cache is being invalidate because project fb852690787f46eab11d8ffc44d63c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:09.108286 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:09.114357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-8350ab4d-9013-471e-bd05-5c099d1bf96c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:09.114357 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1133/2275] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:08 2022] DELETE /identity/v3/projects/fb852690787f46eab11d8ffc44d63c5e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:09.120807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.121097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.121388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.143681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:09.145656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:09.223631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1143/2276] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:09.232128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.232677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.232771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.257230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:09.258809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:09.269035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1134/2277] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:09.274109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.285166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afe59-2bb9-469d-9ce6-58ad5e8869bd None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.290202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.290833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.291110 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.291379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.292044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:43:09.292349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.294036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.317849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1144/2278] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:43:09.319509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.331401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a70f8b-8bad-4c39-b78b-086799ca36c0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.338725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.339682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.339979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.340320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.341148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.345025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.387824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1135/2279] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:09.391431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.402317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db016756-455d-46b5-8d92-a20a2fbb719b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.412910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:09.467242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.467864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.468146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.468421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.469630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.471743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.494690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1145/2280] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:43:09.499067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.509819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37976d4-1376-4475-ad15-7699396dfc00 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.515327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.516121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.516406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.516679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.517328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.518989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.532053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1136/2281] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:09.537370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.548928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfd401-10c0-4f02-b891-1204bb6e800a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.553803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02de051-a276-4080-ad4e-6178e5fefc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.554446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de051-a276-4080-ad4e-6178e5fefc26 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.554727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de051-a276-4080-ad4e-6178e5fefc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.555002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02de051-a276-4080-ad4e-6178e5fefc26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.555647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02de051-a276-4080-ad4e-6178e5fefc26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.557470 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02de051-a276-4080-ad4e-6178e5fefc26 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.569055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1146/2282] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:09.573478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.583978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11cdb-bba2-4290-a3bb-3774b97895dc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.588568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.589196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.589516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.589797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] PATH_INFO: `/v3/projects/608c852818504d9e98ef11f13605da16/users/d3bc9e1e4ca74905b8ad7165be4501cf/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.605184 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=608c852818504d9e98ef11f13605da16, user_id=d3bc9e1e4ca74905b8ad7165be4501cf, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.608074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.622685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1137/2283] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:09 2022] PUT /identity/v3/projects/608c852818504d9e98ef11f13605da16/users/d3bc9e1e4ca74905b8ad7165be4501cf/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:09.634147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.634434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.634706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.663958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] MFA Rules not processed for user `d3bc9e1e4ca74905b8ad7165be4501cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:09.665195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:09.732379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1147/2284] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:09.738068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.803608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14bdb30-96e4-42b2-a8cf-1882d5c89caf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.808295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.808902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.809183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.809472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.810104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.812016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.844874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1138/2285] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:09.848856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.860724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2b58a-e7de-47b8-a7dc-8fe5dc137a83 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.928772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.929543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.929829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.930102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.930748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.932691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.958280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1148/2286] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:09 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:09.962638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:09.976029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ebada4-e279-4244-ae01-6327ef8ba676 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:09.980827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:09.981573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:09.981857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:09.982145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:09.982787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:09.984510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:09.995943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1139/2287] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:09.999984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.011427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31c06ec-67fb-4b14-bbb4-82c482a8b441 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.016809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf0edf-dd11-49f2-99d9-be12a124fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.017477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0edf-dd11-49f2-99d9-be12a124fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.017751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0edf-dd11-49f2-99d9-be12a124fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.018022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf0edf-dd11-49f2-99d9-be12a124fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.018672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf0edf-dd11-49f2-99d9-be12a124fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.020294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf0edf-dd11-49f2-99d9-be12a124fbf2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.022750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:10.034051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1149/2288] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:10.038216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.048612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d78b2a-f118-4f50-833d-dc0179b5de8f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.053868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.054482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.054834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.055649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] PATH_INFO: `/v3/projects/4d5c8b5984ef464ba2ec93aa119cbc46/users/16f0e1cf23ea4e839f151550524bf566/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.073459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5c8b5984ef464ba2ec93aa119cbc46, user_id=16f0e1cf23ea4e839f151550524bf566, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.076338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.092946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1140/2289] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:10 2022] PUT /identity/v3/projects/4d5c8b5984ef464ba2ec93aa119cbc46/users/16f0e1cf23ea4e839f151550524bf566/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:10.103817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.104111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.104390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.139814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] MFA Rules not processed for user `16f0e1cf23ea4e839f151550524bf566`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:10.141926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:10.255452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1150/2290] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:10.260469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.308099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:10.335823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421dcfa-f5b1-4260-ae00-a43bcafd5e3d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.341254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.341887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.342162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.342429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.343071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.344989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.372563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1141/2291] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:10 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:10.377771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.389240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2a80a-a451-4354-849a-fac99bef12a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.459467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.460559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.461118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.461751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.462420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.464758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.501548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1151/2292] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:10 2022] POST /identity/v3/users => generated 299 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:10.506046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.518047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7924af0-4857-41c7-b1ca-8cdffcd29438 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.523456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.524521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.524815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.524998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.525922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.528138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.545577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1142/2293] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:10.546752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.560018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393c052-7b54-4a3f-974b-72a259443dcd admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.566603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.567451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.567910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.568191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] PATH_INFO: `/v3/projects/81abf37f8dbe4ff1b1ee7d2a5c9ebfa5/users/9b8acda4d1b04e5d905b9971865553f0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.590012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81abf37f8dbe4ff1b1ee7d2a5c9ebfa5, user_id=9b8acda4d1b04e5d905b9971865553f0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.592743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.616656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1152/2294] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:10 2022] PUT /identity/v3/projects/81abf37f8dbe4ff1b1ee7d2a5c9ebfa5/users/9b8acda4d1b04e5d905b9971865553f0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:43:10.620433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.633724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.634156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566fdbbc-1cd5-4394-9134-c9488deee352 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.635707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:10.696183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84b3bf-224a-4d45-b656-29cfa4a6547d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.700637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.701319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.701652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.701970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.703804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:10.704916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.705570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.705852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.706121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.706770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.708404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.713378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:10.737418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1143/2295] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:10.738520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:10.754177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca80c2-edda-499b-acbc-9f6a5cb9590b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:10.760366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f3a41-fd22-4336-bca9-01e19ab1e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:10.761051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f3a41-fd22-4336-bca9-01e19ab1e78b admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.761334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f3a41-fd22-4336-bca9-01e19ab1e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.761644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f3a41-fd22-4336-bca9-01e19ab1e78b admin admin] PATH_INFO: `/v3/projects/81abf37f8dbe4ff1b1ee7d2a5c9ebfa5/users/9b8acda4d1b04e5d905b9971865553f0/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.763784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f3a41-fd22-4336-bca9-01e19ab1e78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=81abf37f8dbe4ff1b1ee7d2a5c9ebfa5, user_id=9b8acda4d1b04e5d905b9971865553f0, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.767514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f3a41-fd22-4336-bca9-01e19ab1e78b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.781236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1144/2296] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:10 2022] PUT /identity/v3/projects/81abf37f8dbe4ff1b1ee7d2a5c9ebfa5/users/9b8acda4d1b04e5d905b9971865553f0/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:10.794932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:10.795229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:10.795501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:10.806829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:10.808305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:10.819252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1153/2297] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:43:10.826088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] MFA Rules not processed for user `9b8acda4d1b04e5d905b9971865553f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:10.827236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:10.930314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1145/2298] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:11.117730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:11.119336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:11.139961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8ae68-218a-46ee-b8bc-b54c64e66bc3 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:11.208012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c972c5-3dcf-472c-a62a-136ff5bc7732 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:11.208886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c972c5-3dcf-472c-a62a-136ff5bc7732 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:11.210134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c972c5-3dcf-472c-a62a-136ff5bc7732 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:11.210446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c972c5-3dcf-472c-a62a-136ff5bc7732 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:11.304147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c972c5-3dcf-472c-a62a-136ff5bc7732 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:11.305626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c972c5-3dcf-472c-a62a-136ff5bc7732 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:11.316295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1154/2299] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:11.690031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:11.699748 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24365ade-25f0-45ae-8793-a0e7baec0fc4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:11.703976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:11.704690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:11.705034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:11.705438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:11.707236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:11.729859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:11.778223 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:11.779694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:11.789793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1146/2300] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:11.988385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:11.988979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:11.989145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:12.009820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:12.010956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:12.074315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1155/2301] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:12.091494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:12.092948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:12.174907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab40016-f809-4c63-a45a-34ba9e66a1cc service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:12.180965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:12.181625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:12.181910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:12.182185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:12.191646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:12.193284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:12.203684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1147/2302] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:12.883526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:12.888025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:12.894657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cf8d3-d458-4dbc-a337-672d55b6330d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:12.898301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e07a61-308e-4d8e-a62a-62097b736636 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:12.898903 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07a61-308e-4d8e-a62a-62097b736636 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:12.899180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07a61-308e-4d8e-a62a-62097b736636 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:12.899461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e07a61-308e-4d8e-a62a-62097b736636 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:12.967412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07a61-308e-4d8e-a62a-62097b736636 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:12.969526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e07a61-308e-4d8e-a62a-62097b736636 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:12.988440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1156/2303] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:13.687670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:13.697403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318e99-93ca-4537-bc00-0f91f6f754cf service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:13.701197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:13.701900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:13.702287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:13.702688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:13.714344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:13.715993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:13.727718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1148/2304] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:15.071340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:15.071756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:15.071990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:15.094226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:15.095451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:15.104745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1157/2305] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:15.121314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:15.122932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:15.140834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3e300-b279-4385-92d5-2282226c848e service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:15.158475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9272142-efb0-443e-b2ed-2a33258c4210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:15.159506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9272142-efb0-443e-b2ed-2a33258c4210 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:15.160190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9272142-efb0-443e-b2ed-2a33258c4210 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:15.160902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9272142-efb0-443e-b2ed-2a33258c4210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:15.174506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9272142-efb0-443e-b2ed-2a33258c4210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:15.176975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9272142-efb0-443e-b2ed-2a33258c4210 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:15.207674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1149/2306] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:15.717937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:15.719429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:15.732360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5d5c3-974e-42eb-8a73-421514c2caf7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:15.737520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:15.738152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:15.738432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:15.738702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] PATH_INFO: `/v3/users/bb25f1db6b984e808bd0d74651cad14b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:15.739850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb25f1db6b984e808bd0d74651cad14b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:15.741816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:15.802551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb25f1db6b984e808bd0d74651cad14b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:15.817300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb25f1db6b984e808bd0d74651cad14b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:15.827334 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb25f1db6b984e808bd0d74651cad14b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:15.828280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb25f1db6b984e808bd0d74651cad14b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:15.843138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb25f1db6b984e808bd0d74651cad14b'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:15.850301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1158/2307] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:15 2022] DELETE /identity/v3/users/bb25f1db6b984e808bd0d74651cad14b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:15.856423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:15.856878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:15.857264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:15.888034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:15.889261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:15.949935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1150/2308] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:15.963367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:15.964873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:16.031047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d271-bec8-43c7-99c3-16fa06581de6 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:16.034753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:16.035358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:16.035639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:16.035912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:16.044840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:16.046317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:16.055687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1159/2309] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:16.429332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:16.430878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:16.443316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f517e91-8856-44f1-ae66-296754660bd5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:16.450787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:16.451447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:16.451728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:16.452427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] PATH_INFO: `/v3/projects/291173a2b94747319d79014f978faae4` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:16.459707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=291173a2b94747319d79014f978faae4)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:16.461773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:16.472043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:16.515190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '291173a2b94747319d79014f978faae4', 'request_id': 'req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.524790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '291173a2b94747319d79014f978faae4', 'request_id': 'req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.532968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '291173a2b94747319d79014f978faae4', 'request_id': 'req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.546648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] The token cache is being invalidate because project 291173a2b94747319d79014f978faae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:16.546993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.547676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.549163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1151/2310] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:16 2022] DELETE /identity/v3/projects/291173a2b94747319d79014f978faae4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:16.553087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:16.565882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e302af92-ba60-425f-9d3d-0211db090eb6 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:16.571501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:16.645484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:16.646245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:16.646618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:16.647030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] PATH_INFO: `/v3/users/9fd4460f4c93466ea58e17c14a5dd5d8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:16.649392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd4460f4c93466ea58e17c14a5dd5d8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:16.650204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:16.703795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd4460f4c93466ea58e17c14a5dd5d8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.713031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd4460f4c93466ea58e17c14a5dd5d8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.724304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd4460f4c93466ea58e17c14a5dd5d8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.725101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd4460f4c93466ea58e17c14a5dd5d8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.748912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd4460f4c93466ea58e17c14a5dd5d8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:16.756173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1160/2311] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:16 2022] DELETE /identity/v3/users/9fd4460f4c93466ea58e17c14a5dd5d8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:17.173492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:17.175167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:17.188343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf6e7f-82ea-4e12-9d96-1c2c1f152cd6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:17.256089 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:17.256713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:17.256989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:17.257271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] PATH_INFO: `/v3/projects/25f69a0c05174b54871cb0d7e38ee151` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:17.258388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f69a0c05174b54871cb0d7e38ee151)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:17.260316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:17.306542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f69a0c05174b54871cb0d7e38ee151', 'request_id': 'req-d74f7e30-3661-4552-b786-f0240c1fc7fa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.315107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f69a0c05174b54871cb0d7e38ee151', 'request_id': 'req-d74f7e30-3661-4552-b786-f0240c1fc7fa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.322970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f69a0c05174b54871cb0d7e38ee151', 'request_id': 'req-d74f7e30-3661-4552-b786-f0240c1fc7fa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.336439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] The token cache is being invalidate because project 25f69a0c05174b54871cb0d7e38ee151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:17.336734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.337772 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.339339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1152/2312] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:17 2022] DELETE /identity/v3/projects/25f69a0c05174b54871cb0d7e38ee151 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:17.343606 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:17.345137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:17.358652 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b633a-3b83-48dd-8b2b-425e8ed6b88f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:17.429610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:17.430254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:17.430543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:17.430823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] PATH_INFO: `/v3/users/01868cdd9d854e588e23c2a8853f35fb` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:17.432274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01868cdd9d854e588e23c2a8853f35fb)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:17.434467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:17.473132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:17.489730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01868cdd9d854e588e23c2a8853f35fb'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.496996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01868cdd9d854e588e23c2a8853f35fb'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.505164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01868cdd9d854e588e23c2a8853f35fb'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.505888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01868cdd9d854e588e23c2a8853f35fb'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.519627 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01868cdd9d854e588e23c2a8853f35fb'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.526488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1161/2313] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:17 2022] DELETE /identity/v3/users/01868cdd9d854e588e23c2a8853f35fb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:17.807009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:17.808493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:17.821403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7e30-3661-4552-b786-f0240c1fc7fa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:17.850292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:17.886983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:17.887657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:17.887938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:17.888207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] PATH_INFO: `/v3/projects/8ff01258e94c4d6a90f1099b8aa2ff78` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:17.889370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff01258e94c4d6a90f1099b8aa2ff78)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:17.891315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:17.940228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff01258e94c4d6a90f1099b8aa2ff78', 'request_id': 'req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.948709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff01258e94c4d6a90f1099b8aa2ff78', 'request_id': 'req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.954079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:17.955152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff01258e94c4d6a90f1099b8aa2ff78', 'request_id': 'req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.955596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:17.966551 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] The token cache is being invalidate because project 8ff01258e94c4d6a90f1099b8aa2ff78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:17.966841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.967475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d8bdbd12-20e7-4593-8852-c6be1f8c5fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:17.969160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3a185-e198-4d3a-9690-3c6f40c22b77 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:17.969332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1153/2314] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:17 2022] DELETE /identity/v3/projects/8ff01258e94c4d6a90f1099b8aa2ff78 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:17.973800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5e58-e046-4753-a4fa-352b9c636359 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:17.974094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5e58-e046-4753-a4fa-352b9c636359 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:17.974374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f5e58-e046-4753-a4fa-352b9c636359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:17.997176 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-de6f5e58-e046-4753-a4fa-352b9c636359 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:17.998435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-de6f5e58-e046-4753-a4fa-352b9c636359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.030431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.030992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.031321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.032061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] PATH_INFO: `/v3/users/d3bc9e1e4ca74905b8ad7165be4501cf` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.032983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3bc9e1e4ca74905b8ad7165be4501cf)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.035036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.072929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1154/2315] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:18.080303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.080700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.081718 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.104588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:18.105845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.114725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1155/2316] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:43:18.118329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3bc9e1e4ca74905b8ad7165be4501cf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.119597 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.123341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3bc9e1e4ca74905b8ad7165be4501cf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.131697 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad318b6-0460-414a-bce4-4341b2e5090d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.133109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3bc9e1e4ca74905b8ad7165be4501cf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.133764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3bc9e1e4ca74905b8ad7165be4501cf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.139367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.139984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.140263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.147302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.152096 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:43:18.152423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.154124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.163628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-a83d7bde-1990-471a-bfcb-5d03b16398df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3bc9e1e4ca74905b8ad7165be4501cf'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.175309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1162/2317] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:17 2022] DELETE /identity/v3/users/d3bc9e1e4ca74905b8ad7165be4501cf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:43:18.178898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1156/2318] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:43:18.182505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c877aa3-1a70-443b-a121-879e2868418a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.182838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c877aa3-1a70-443b-a121-879e2868418a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.183128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.183296 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c877aa3-1a70-443b-a121-879e2868418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.184846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.198873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b371d-b52c-4ad5-8e94-ab2becf94945 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.204397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2c877aa3-1a70-443b-a121-879e2868418a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:18.205651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2c877aa3-1a70-443b-a121-879e2868418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.229490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:18.239333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:18.275868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.276803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.277150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.277547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.278924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.281936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.291681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1163/2319] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:18.292756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.293049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.293327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.326161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1157/2320] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:18 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:43:18.327101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.330763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.335484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:18.339317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.395986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c2b59-17cc-45a8-a10a-6993274eae3b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.400562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.401417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.401805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.402280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.418106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1164/2321] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:18.419021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.433621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d740ee2b-276b-4124-a4b3-bb132209db3e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.439431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.441083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.441463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.441831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.442549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.444538 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.470469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1165/2322] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:18 2022] POST /identity/v3/users => generated 286 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:18.471437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.472986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.478776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.480237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.490034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1158/2323] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:18.490915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.501212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a395e5-23b2-4eea-b21e-0c3a15091a50 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.506690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.507305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.507658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.508004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.508721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.510565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.521482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1159/2324] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:18.525844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.542984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842d203-3fb4-446b-b08b-9841acbeca5d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.554753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.555807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.556203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.556599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.557723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.560850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.575297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1160/2325] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:43:18.579744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.583957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c6f4-90f1-4498-8ba2-bfc83ae7c9b5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.591055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d7f3c-cfe2-496b-80be-158cc930c6d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.591610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d7f3c-cfe2-496b-80be-158cc930c6d4 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.592377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d7f3c-cfe2-496b-80be-158cc930c6d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.592377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d7f3c-cfe2-496b-80be-158cc930c6d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.593436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd52013-69a5-4ed9-9f24-b30b1792b03f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.598805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.599465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.599838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.600018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] PATH_INFO: `/v3/projects/d424c1a19f484ba39272639182d152a3/users/2136c2e8b49d4cfd9ed761d7b8d9ec06/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.602238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d7f3c-cfe2-496b-80be-158cc930c6d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.604140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91d7f3c-cfe2-496b-80be-158cc930c6d4 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.614677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1166/2326] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:18.617159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d424c1a19f484ba39272639182d152a3, user_id=2136c2e8b49d4cfd9ed761d7b8d9ec06, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.620006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.637873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1161/2327] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:18 2022] PUT /identity/v3/projects/d424c1a19f484ba39272639182d152a3/users/2136c2e8b49d4cfd9ed761d7b8d9ec06/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:43:18.644245 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.644536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.644800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.665216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:18.666471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.699106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:18.753661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1167/2328] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:18.762417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.826786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:18.867647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.869729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:18.878267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f135f-a5a5-4861-8828-8c557ebce4d8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.882837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.883626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.883919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.884191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.885524 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bef0b-29b4-4fc8-ab20-245bd084c78b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:18.890226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:18.890924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:18.891206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:18.891480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] PATH_INFO: `/v3/projects/608c852818504d9e98ef11f13605da16` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:18.892619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608c852818504d9e98ef11f13605da16)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.894724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:18.895193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.897138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:18.907447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1162/2329] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:18.948721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608c852818504d9e98ef11f13605da16', 'request_id': 'req-da9f9c46-d00c-4021-a5d3-6b9ac4744836'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.957014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608c852818504d9e98ef11f13605da16', 'request_id': 'req-da9f9c46-d00c-4021-a5d3-6b9ac4744836'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.963276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608c852818504d9e98ef11f13605da16', 'request_id': 'req-da9f9c46-d00c-4021-a5d3-6b9ac4744836'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.974950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] The token cache is being invalidate because project 608c852818504d9e98ef11f13605da16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:18.975241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.975915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:18.977451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1168/2330] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:18 2022] DELETE /identity/v3/projects/608c852818504d9e98ef11f13605da16 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:43:18.981631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:18.993429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bd96c-2253-44f0-8dd5-1b042677e43f service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:19.057476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:19.058138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:19.058444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:19.058722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] PATH_INFO: `/v3/users/16f0e1cf23ea4e839f151550524bf566` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:19.059877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f0e1cf23ea4e839f151550524bf566)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:19.061898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:19.121198 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f0e1cf23ea4e839f151550524bf566'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.129476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f0e1cf23ea4e839f151550524bf566'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.157206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f0e1cf23ea4e839f151550524bf566'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.158162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f0e1cf23ea4e839f151550524bf566'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.158904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-573a6288-ff95-446a-adbd-ed042c5648f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f0e1cf23ea4e839f151550524bf566'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.192064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1163/2331] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:18 2022] DELETE /identity/v3/users/16f0e1cf23ea4e839f151550524bf566 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:19.766471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:19.768417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:19.786096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f9c46-d00c-4021-a5d3-6b9ac4744836 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:19.850981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:19.851612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:19.852661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:19.868751 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:19.869436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:19.869724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:19.870003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] PATH_INFO: `/v3/projects/4d5c8b5984ef464ba2ec93aa119cbc46` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:19.871263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5c8b5984ef464ba2ec93aa119cbc46)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:19.873414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:19.900174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] MFA Rules not processed for user `2136c2e8b49d4cfd9ed761d7b8d9ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:19.901441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:19.971865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5c8b5984ef464ba2ec93aa119cbc46', 'request_id': 'req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.977416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:19.982203 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5c8b5984ef464ba2ec93aa119cbc46', 'request_id': 'req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:19.987987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:19.991892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5c8b5984ef464ba2ec93aa119cbc46', 'request_id': 'req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.007728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] The token cache is being invalidate because project 4d5c8b5984ef464ba2ec93aa119cbc46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:20.008443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.009492 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.019512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1169/2332] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:19 2022] DELETE /identity/v3/projects/4d5c8b5984ef464ba2ec93aa119cbc46 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:20.020648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:20.022489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:20.038721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1164/2333] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:20.065262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:20.067002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:20.099081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d65446-22f4-4fa5-9a1b-6cbdd7acd97f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:20.104058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:20.105511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.105792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.106060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] PATH_INFO: `/v3/users/9b8acda4d1b04e5d905b9971865553f0` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.107806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b8acda4d1b04e5d905b9971865553f0)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:20.110381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:20.145073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a9c7a-a3b6-43e6-a79d-a7153eb6d2a1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:20.175468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b8acda4d1b04e5d905b9971865553f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.184542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b8acda4d1b04e5d905b9971865553f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.193908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b8acda4d1b04e5d905b9971865553f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.194590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b8acda4d1b04e5d905b9971865553f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.210090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b8acda4d1b04e5d905b9971865553f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.211560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:20.212241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.212522 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.212795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.215162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:20.218211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1170/2334] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:20 2022] DELETE /identity/v3/users/9b8acda4d1b04e5d905b9971865553f0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:20.287874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:20.289385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe546adb-98c8-4b66-9b69-ebda669be306 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:20.303810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1165/2335] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:20.507402 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:20.509174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:20.616059 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6edf5-3b80-4ef0-9462-e571baf1af1c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:20.618381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:20.619099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.619450 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.619789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] PATH_INFO: `/v3/projects/81abf37f8dbe4ff1b1ee7d2a5c9ebfa5` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.620913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81abf37f8dbe4ff1b1ee7d2a5c9ebfa5)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:20.622847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:20.638376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:20.680917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81abf37f8dbe4ff1b1ee7d2a5c9ebfa5', 'request_id': 'req-4bf8f999-6112-4887-bfa8-de10f20ba6a2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.688894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81abf37f8dbe4ff1b1ee7d2a5c9ebfa5', 'request_id': 'req-4bf8f999-6112-4887-bfa8-de10f20ba6a2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.695756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81abf37f8dbe4ff1b1ee7d2a5c9ebfa5', 'request_id': 'req-4bf8f999-6112-4887-bfa8-de10f20ba6a2'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.708955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] The token cache is being invalidate because project 81abf37f8dbe4ff1b1ee7d2a5c9ebfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:20.709243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.709935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-4bf8f999-6112-4887-bfa8-de10f20ba6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:20.711429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1171/2336] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:20 2022] DELETE /identity/v3/projects/81abf37f8dbe4ff1b1ee7d2a5c9ebfa5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:20.717738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.718026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.718301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.739649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:20.740808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:20.799431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:20.822902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1166/2337] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:20.831259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.831546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.831820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.852987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:20.858952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:20.869764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1172/2338] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:20.874419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:20.885953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c1249-7e47-4bd8-ad9a-ff3fbf24825e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:20.890702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:20.891314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.891594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.891872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.892525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:43:20.892826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:20.894496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:20.913672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1167/2339] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:43:20.919890 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:20.932381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87075639-9eb1-45f6-a3ed-d4fd6fd229a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:20.938108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:20.938790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:20.939079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:20.939284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:20.939940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:20.942001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:20.971413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1173/2340] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:43:20 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:20.975835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:20.987049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da921b42-c92b-41fd-9443-7b9522bab795 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:21.048108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:21.048724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.049010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.049285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.049986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:21.052164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:21.094939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1168/2341] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:43:20 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:43:21.102433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:21.117625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477953-115f-4589-afcd-7e436e86127d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:21.123481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:21.124229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.124609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.125783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.127336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:21.129907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:21.141920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1174/2342] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:21.146047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:21.160945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be49cc3-9563-42f2-9d1d-269e8bdbeabb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:21.166135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d680a-494e-4cb7-b8d5-955f6275ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:21.166887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d680a-494e-4cb7-b8d5-955f6275ba2a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.167208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d680a-494e-4cb7-b8d5-955f6275ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.167430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d680a-494e-4cb7-b8d5-955f6275ba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.168069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d680a-494e-4cb7-b8d5-955f6275ba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:21.169743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d680a-494e-4cb7-b8d5-955f6275ba2a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:21.184540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1169/2343] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:43:21.189497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:21.199628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4122a94-2732-462a-a62c-1440cf67968d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:21.205102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:21.205804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.206085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.206357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] PATH_INFO: `/v3/projects/d4ac6d5eefef4dc98658e1b2dd0b5df9/users/0e5b057526f3497d8f06fe9d6d8f7b9a/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.222925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ac6d5eefef4dc98658e1b2dd0b5df9, user_id=0e5b057526f3497d8f06fe9d6d8f7b9a, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:21.225957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:21.241801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1175/2344] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:43:21 2022] PUT /identity/v3/projects/d4ac6d5eefef4dc98658e1b2dd0b5df9/users/0e5b057526f3497d8f06fe9d6d8f7b9a/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:21.253545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6f208-1d07-4c19-860c-f63243cb1416 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.253837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6f208-1d07-4c19-860c-f63243cb1416 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.254117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6f208-1d07-4c19-860c-f63243cb1416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.290833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6df6f208-1d07-4c19-860c-f63243cb1416 None None] MFA Rules not processed for user `0e5b057526f3497d8f06fe9d6d8f7b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:21.292607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6df6f208-1d07-4c19-860c-f63243cb1416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:21.369482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1170/2345] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:21.380946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:21.382788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:21.440905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4d7f4-e758-4944-bfe9-8638c1a84c98 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:21.444597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372246cc-c8ff-46e7-8cfe-9177d8bd1aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:21.445204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372246cc-c8ff-46e7-8cfe-9177d8bd1aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.445513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372246cc-c8ff-46e7-8cfe-9177d8bd1aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.445789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372246cc-c8ff-46e7-8cfe-9177d8bd1aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.454148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372246cc-c8ff-46e7-8cfe-9177d8bd1aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:21.455576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372246cc-c8ff-46e7-8cfe-9177d8bd1aa8 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:21.466262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1176/2346] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:21.716370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:21.716662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:21.716962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:21.737434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] MFA Rules not processed for user `2136c2e8b49d4cfd9ed761d7b8d9ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:21.738806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:21.799168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:21.822268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1171/2347] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:22.422093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00e51-f29f-4124-aad4-488af9162f5e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:22.422616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00e51-f29f-4124-aad4-488af9162f5e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:22.422616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe00e51-f29f-4124-aad4-488af9162f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:22.450446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bfe00e51-f29f-4124-aad4-488af9162f5e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:22.461447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bfe00e51-f29f-4124-aad4-488af9162f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:22.524103 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:22.575946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1177/2348] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:22.599830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:22.603383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:22.716864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308edfd3-9d5e-4c2b-9f9d-42a65fee7fbb None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:22.726729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:22.727433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:22.727694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:22.728017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:22.746714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:22.748735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:22.761254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1172/2349] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:22.914790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd8964-7650-4462-8d03-5ea9162f4fbd None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:22.915066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd8964-7650-4462-8d03-5ea9162f4fbd None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:22.915340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd8964-7650-4462-8d03-5ea9162f4fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:22.940022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-23fd8964-7650-4462-8d03-5ea9162f4fbd None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:22.941719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-23fd8964-7650-4462-8d03-5ea9162f4fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:23.009094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1178/2350] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:43:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:23.062387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:23.063858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:23.143261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e402-1608-4989-b2b6-0f94ac53368f service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:23.149826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:23.150724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:23.151195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:23.151694 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:23.161864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:23.163467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:23.171806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1173/2351] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:43:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:43:25.741828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:25.742995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:25.743497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:25.787531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:25.787531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:25.797748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1179/2352] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:25.944568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:25.958735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3980e3-6263-41d8-92d5-5bb8a1097d69 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:25.965628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e46bb-7cbc-4f37-b11f-034cf3067351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:25.966239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e46bb-7cbc-4f37-b11f-034cf3067351 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:25.966519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e46bb-7cbc-4f37-b11f-034cf3067351 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:25.966786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e46bb-7cbc-4f37-b11f-034cf3067351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:25.977273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e46bb-7cbc-4f37-b11f-034cf3067351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:25.978914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e46bb-7cbc-4f37-b11f-034cf3067351 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:25.990591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1174/2353] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:32.307748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:32.320614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c44724-065b-4e00-844d-df7a556514c6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:32.335717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:32.336411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:32.336691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:32.336965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] PATH_INFO: `/v3/users/0e5b057526f3497d8f06fe9d6d8f7b9a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:32.338313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5b057526f3497d8f06fe9d6d8f7b9a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:32.340290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:32.476096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5b057526f3497d8f06fe9d6d8f7b9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:32.491857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5b057526f3497d8f06fe9d6d8f7b9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:32.502345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5b057526f3497d8f06fe9d6d8f7b9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:32.503275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5b057526f3497d8f06fe9d6d8f7b9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:32.523892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5b057526f3497d8f06fe9d6d8f7b9a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:32.548438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1180/2354] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:43:32 2022] DELETE /identity/v3/users/0e5b057526f3497d8f06fe9d6d8f7b9a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:32.553448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48865c-0925-473a-8a60-354854c6f36c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:32.554032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48865c-0925-473a-8a60-354854c6f36c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:32.554224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48865c-0925-473a-8a60-354854c6f36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:32.587595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2f48865c-0925-473a-8a60-354854c6f36c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:32.591581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2f48865c-0925-473a-8a60-354854c6f36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:32.689644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:32.709317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1175/2355] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:32.730825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:32.732985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:32.824061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:32.831938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55d1a8-74b8-44b9-b90d-7934414ddf7a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:32.838709 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:32.839446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:32.840082 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:32.840533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:32.853566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:32.855285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:32.869779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1181/2356] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:33.246631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453291c-d5b1-4d42-b291-df127ab389d6 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:33.246631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453291c-d5b1-4d42-b291-df127ab389d6 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:33.246631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453291c-d5b1-4d42-b291-df127ab389d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:33.285180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5453291c-d5b1-4d42-b291-df127ab389d6 None None] MFA Rules not processed for user `7b153ae4d44c452689451adf19c680b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:33.286605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5453291c-d5b1-4d42-b291-df127ab389d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:33.363005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1176/2357] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:33.625478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:33.628293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:33.675614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57ac021-43e9-4289-ba94-fb34d15c9110 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:33.717211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:33.717950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:33.718275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:33.718528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] PATH_INFO: `/v3/projects/d4ac6d5eefef4dc98658e1b2dd0b5df9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:33.719938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ac6d5eefef4dc98658e1b2dd0b5df9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:33.722105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:33.957703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ac6d5eefef4dc98658e1b2dd0b5df9', 'request_id': 'req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:33.970459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ac6d5eefef4dc98658e1b2dd0b5df9', 'request_id': 'req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:33.989165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ac6d5eefef4dc98658e1b2dd0b5df9', 'request_id': 'req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:34.016663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] The token cache is being invalidate because project d4ac6d5eefef4dc98658e1b2dd0b5df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:43:34.016956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:34.020426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-51cf56ba-959d-4151-9f0d-c3e3348ecc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:43:34.022941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1182/2358] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:43:33 2022] DELETE /identity/v3/projects/d4ac6d5eefef4dc98658e1b2dd0b5df9 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:43:43.352305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=29 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:44.012467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:45.076622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e130d-3e44-4414-974a-d1e151c91fa7 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.077091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e130d-3e44-4414-974a-d1e151c91fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.077300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e130d-3e44-4414-974a-d1e151c91fa7 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.079306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1177/2359] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:43:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:43:45.088960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cbe3-2195-4688-8aa4-08cf09cae93b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.089481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cbe3-2195-4688-8aa4-08cf09cae93b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.091148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122cbe3-2195-4688-8aa4-08cf09cae93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.133155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f122cbe3-2195-4688-8aa4-08cf09cae93b None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:45.135031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f122cbe3-2195-4688-8aa4-08cf09cae93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:45.262551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1183/2360] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:43:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:45.276831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e130d-3e44-4414-974a-d1e151c91fa7 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:45.278734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ee8e130d-3e44-4414-974a-d1e151c91fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:45.404267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e130d-3e44-4414-974a-d1e151c91fa7 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:45.408955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19299a-acfd-47cb-8de5-001e2991ebe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:45.409645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19299a-acfd-47cb-8de5-001e2991ebe4 service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.409978 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19299a-acfd-47cb-8de5-001e2991ebe4 service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.410248 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19299a-acfd-47cb-8de5-001e2991ebe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.424767 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19299a-acfd-47cb-8de5-001e2991ebe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:45.426424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19299a-acfd-47cb-8de5-001e2991ebe4 service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:45.439506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1178/2361] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:45.515789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76cfa1-522c-474b-a189-1caeef768f2a None None] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.516196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76cfa1-522c-474b-a189-1caeef768f2a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.516831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76cfa1-522c-474b-a189-1caeef768f2a None None] PATH_INFO: `/` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.518385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1184/2362] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:43:45.524078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf203ff-c009-4eb1-9dd4-3eb6e599d40d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.524742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf203ff-c009-4eb1-9dd4-3eb6e599d40d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.525121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf203ff-c009-4eb1-9dd4-3eb6e599d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.550219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8bf203ff-c009-4eb1-9dd4-3eb6e599d40d None None] MFA Rules not processed for user `e0b4196792fe44f2a8fb31bba5a6006e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:45.552099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8bf203ff-c009-4eb1-9dd4-3eb6e599d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:45.611463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1179/2363] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:43:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:45.624636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76cfa1-522c-474b-a189-1caeef768f2a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:45.626194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8f76cfa1-522c-474b-a189-1caeef768f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:45.640900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76cfa1-522c-474b-a189-1caeef768f2a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:45.644820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb982-fddb-40ad-b208-ce0c4fd14804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:45.645478 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb982-fddb-40ad-b208-ce0c4fd14804 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.645738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb982-fddb-40ad-b208-ce0c4fd14804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.646106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb982-fddb-40ad-b208-ce0c4fd14804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.654164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cb982-fddb-40ad-b208-ce0c4fd14804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:45.656297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cb982-fddb-40ad-b208-ce0c4fd14804 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:45.664461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1185/2364] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:45.778194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08834a8-096b-4ea2-a53c-e5961ac2bbe2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.778477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08834a8-096b-4ea2-a53c-e5961ac2bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.778751 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08834a8-096b-4ea2-a53c-e5961ac2bbe2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.780774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1180/2365] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:43:45.786440 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6341ee-3eec-4b85-8617-17ad44439593 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.786802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6341ee-3eec-4b85-8617-17ad44439593 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.787146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6341ee-3eec-4b85-8617-17ad44439593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.807432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-bb6341ee-3eec-4b85-8617-17ad44439593 None None] MFA Rules not processed for user `09019a1191eb4b4194c245dff90ef942`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:45.808635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bb6341ee-3eec-4b85-8617-17ad44439593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:45.823223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1186/2366] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:43:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:45.835405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08834a8-096b-4ea2-a53c-e5961ac2bbe2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:45.852211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08834a8-096b-4ea2-a53c-e5961ac2bbe2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:45.857111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa78272-abd3-417b-8303-44ab2c22d56c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:45.858067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa78272-abd3-417b-8303-44ab2c22d56c service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:45.858753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa78272-abd3-417b-8303-44ab2c22d56c service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:45.859488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa78272-abd3-417b-8303-44ab2c22d56c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:45.873229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa78272-abd3-417b-8303-44ab2c22d56c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:45.874816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa78272-abd3-417b-8303-44ab2c22d56c service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:45.889981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1181/2367] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:43:47.016403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375cd6-1ed7-41c0-bcfb-0067a353ba89 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:47.017006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375cd6-1ed7-41c0-bcfb-0067a353ba89 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:47.017006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375cd6-1ed7-41c0-bcfb-0067a353ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:47.038352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-df375cd6-1ed7-41c0-bcfb-0067a353ba89 None None] MFA Rules not processed for user `2136c2e8b49d4cfd9ed761d7b8d9ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:47.039684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-df375cd6-1ed7-41c0-bcfb-0067a353ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:47.096654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1187/2368] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:43:48.913576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27428513-df4f-4a1d-8eff-38712372117d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:48.914145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27428513-df4f-4a1d-8eff-38712372117d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:48.914145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27428513-df4f-4a1d-8eff-38712372117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:48.932861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-27428513-df4f-4a1d-8eff-38712372117d None None] MFA Rules not processed for user `9aa9db920f10441bb41a95feca5585f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:48.934112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-27428513-df4f-4a1d-8eff-38712372117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:48.996846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1182/2369] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:43:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:49.420529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d920998-7a79-46c3-9be7-617dd68de972 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:49.421003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d920998-7a79-46c3-9be7-617dd68de972 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:49.421692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d920998-7a79-46c3-9be7-617dd68de972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:49.444317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6d920998-7a79-46c3-9be7-617dd68de972 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:43:49.445932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6d920998-7a79-46c3-9be7-617dd68de972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:49.522280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1188/2370] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:43:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:43:49.545944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27428513-df4f-4a1d-8eff-38712372117d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:43:49.547496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-27428513-df4f-4a1d-8eff-38712372117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:43:49.604269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:49.644966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27428513-df4f-4a1d-8eff-38712372117d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:43:49.651674 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:43:49.652293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:43:49.652569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:43:49.652838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:43:49.663814 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:43:49.665544 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:43:49.676986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1183/2371] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:43:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:43:59.513632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:43:59.671053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=12 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:06.036775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe9cea-e201-41d7-b756-61c23f1f7660 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:06.037268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe9cea-e201-41d7-b756-61c23f1f7660 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:06.037408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe9cea-e201-41d7-b756-61c23f1f7660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:06.064553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fbbe9cea-e201-41d7-b756-61c23f1f7660 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:06.066407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fbbe9cea-e201-41d7-b756-61c23f1f7660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:06.074330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1189/2372] 10.222.0.67 () {58 vars in 967 bytes} [Mon Aug 29 23:44:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:06.098136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:06.109128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5515c-2b4f-4e04-bdf3-33c29a161cbf service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:06.114952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d23617-7e1d-4ef3-b0d4-36654bd1b0ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:06.115583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d23617-7e1d-4ef3-b0d4-36654bd1b0ea service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:06.115864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d23617-7e1d-4ef3-b0d4-36654bd1b0ea service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:06.116138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d23617-7e1d-4ef3-b0d4-36654bd1b0ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:06.128666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d23617-7e1d-4ef3-b0d4-36654bd1b0ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:06.130381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d23617-7e1d-4ef3-b0d4-36654bd1b0ea service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:06.139995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1184/2373] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:44:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:44:16.053200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:16.136661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:17.307781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:17.308268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:17.308511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:17.319243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2bbe5-ce30-4d55-8171-84bed1bf310f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:17.319763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2bbe5-ce30-4d55-8171-84bed1bf310f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:17.319866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2bbe5-ce30-4d55-8171-84bed1bf310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:17.330360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:17.331559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:17.339473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1190/2374] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:44:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:17.340643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-d4f2bbe5-ce30-4d55-8171-84bed1bf310f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:17.341944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d4f2bbe5-ce30-4d55-8171-84bed1bf310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:17.352682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:17.366244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb147-dc3c-4dfc-9a3c-3bd0b27dacac None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:17.371869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:17.373023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:17.373306 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:17.373616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:17.382897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:17.384537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:17.394767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1191/2375] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:44:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:44:17.418371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1185/2376] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:44:17.433883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:17.435510 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:17.451872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95859a-bbd8-4a9e-9714-3193f893e0a1 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:17.462009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:17.462656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:17.462934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:17.463277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:17.472979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:17.474724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:17.486978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1192/2377] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:20.579431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342ef5-1345-4df1-b13c-4c4531feb346 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:20.580027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342ef5-1345-4df1-b13c-4c4531feb346 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:20.580027 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37342ef5-1345-4df1-b13c-4c4531feb346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:20.607660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-37342ef5-1345-4df1-b13c-4c4531feb346 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:20.609686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-37342ef5-1345-4df1-b13c-4c4531feb346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:20.623810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1186/2378] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:20.645668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:20.647359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:20.664799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9ef9-a49e-42db-85ba-694136c906a8 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:20.671865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:20.672760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:20.674113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:20.674842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:20.685210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:20.686898 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:20.710819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1193/2379] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:23.681139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16d3ca-8270-42a3-aeb7-0384b4aa6e66 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:23.681784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16d3ca-8270-42a3-aeb7-0384b4aa6e66 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:23.681784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16d3ca-8270-42a3-aeb7-0384b4aa6e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:23.704464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-9b16d3ca-8270-42a3-aeb7-0384b4aa6e66 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:23.706105 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9b16d3ca-8270-42a3-aeb7-0384b4aa6e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:23.716200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1187/2380] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:23.733081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:23.747763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2cf55-85d7-494d-9b7e-d457959bbc86 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:23.755723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:23.756655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:23.757160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:23.757631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:23.774179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:23.776261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:23.790765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1194/2381] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:26.865589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddbb28-3970-4ab8-9eea-71d25c770ccf None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:26.866147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddbb28-3970-4ab8-9eea-71d25c770ccf None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:26.866673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddbb28-3970-4ab8-9eea-71d25c770ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:26.894065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-32ddbb28-3970-4ab8-9eea-71d25c770ccf None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:26.895299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-32ddbb28-3970-4ab8-9eea-71d25c770ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:26.903704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1188/2382] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:26.925604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:26.938138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44030f2a-bf17-4714-b225-33e6b37b7a46 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:26.944986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:26.945888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:26.946445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:26.946769 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:26.956451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:26.958882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:26.973531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1195/2383] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:30.060907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9192a-bd04-4400-afb3-f1267a2c2639 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:30.061525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9192a-bd04-4400-afb3-f1267a2c2639 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:30.061525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9192a-bd04-4400-afb3-f1267a2c2639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:30.084398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ada9192a-bd04-4400-afb3-f1267a2c2639 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:30.085687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ada9192a-bd04-4400-afb3-f1267a2c2639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:30.094916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1189/2384] 10.222.0.94 () {58 vars in 1016 bytes} [Mon Aug 29 23:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:30.136050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:30.160701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09d21b-755a-4dd4-af16-26d1cc7135fc service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:30.170174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:30.171184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:30.171722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:30.172408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:30.187189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:30.189377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:30.201954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1196/2385] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:33.054236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:33.054804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:33.054804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:33.073776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:33.074998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:33.082775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1190/2386] 10.222.0.67 () {58 vars in 967 bytes} [Mon Aug 29 23:44:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:33.095937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:33.107412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d5fbb-c6b8-4741-86b8-0a094b262913 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:33.112515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:33.113133 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:33.113454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:33.113726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:33.122395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:33.123970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:33.132790 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1197/2387] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:44:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:44:35.443060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:35.444524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:35.460620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937d95-97ea-4ea3-b2a4-4a848c505d3e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:35.468466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:35.469389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:35.469676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:35.469951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] PATH_INFO: `/v3/users/2136c2e8b49d4cfd9ed761d7b8d9ec06` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:35.471118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2136c2e8b49d4cfd9ed761d7b8d9ec06)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:35.474227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:35.521818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2136c2e8b49d4cfd9ed761d7b8d9ec06'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.528590 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2136c2e8b49d4cfd9ed761d7b8d9ec06'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.541728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2136c2e8b49d4cfd9ed761d7b8d9ec06'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.542433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2136c2e8b49d4cfd9ed761d7b8d9ec06'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.543067 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-296ecc99-3949-4396-8e82-0b2ae8604874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2136c2e8b49d4cfd9ed761d7b8d9ec06'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.555702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1191/2388] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:44:35 2022] DELETE /identity/v3/users/2136c2e8b49d4cfd9ed761d7b8d9ec06 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:44:35.728026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:35.742352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6313e-ed35-4077-bc98-f5a686e7ac51 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:35.806851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:35.807499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:35.807781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:35.808056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] PATH_INFO: `/v3/projects/d424c1a19f484ba39272639182d152a3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:35.809210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d424c1a19f484ba39272639182d152a3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:35.811174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:35.863587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd424c1a19f484ba39272639182d152a3', 'request_id': 'req-5914cf27-7cc4-4083-8572-74908fff47f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.871324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd424c1a19f484ba39272639182d152a3', 'request_id': 'req-5914cf27-7cc4-4083-8572-74908fff47f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.880221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:35.881825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd424c1a19f484ba39272639182d152a3', 'request_id': 'req-5914cf27-7cc4-4083-8572-74908fff47f6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.894508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] The token cache is being invalidate because project d424c1a19f484ba39272639182d152a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:44:35.894796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.895489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-5914cf27-7cc4-4083-8572-74908fff47f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:44:35.897026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1198/2389] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:44:35 2022] DELETE /identity/v3/projects/d424c1a19f484ba39272639182d152a3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:44:35.902091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:35.902401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:35.902678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:35.922713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:35.923926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:35.957839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:35.985968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1192/2390] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:44:35.993647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:35.993934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:35.994212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.014771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:36.016038 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:36.024314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1199/2391] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:36.028576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.038293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9840487-c5c8-4416-a6b2-2d351f6e5a51 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.042862 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.043458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.043738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.044014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.044661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:44:36.044990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.046641 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.061018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1193/2392] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:44:36.066215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.075417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32e245-f6c0-4249-8892-4215f1716a9d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.080162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.080763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.081044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.081320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.081986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.084141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.115928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1200/2393] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:44:36 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:44:36.117100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.127677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c698d8d3-71f4-4fa6-9f0b-8e8561ce8c34 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.189233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.189871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.190153 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.190425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.191058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.193031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.216703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1194/2394] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:44:36 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:44:36.221235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.231406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae077d46-28a8-47f6-bf28-646927ab607f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.237021 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.237586 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.237865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.238137 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.238779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.240368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.250200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1201/2395] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:44:36.254035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.264206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2507e86-dbb1-4e4e-a8d3-a2ec38328dcf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.269032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16268baf-fbb7-42e6-89ff-eea4d0698757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.269659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16268baf-fbb7-42e6-89ff-eea4d0698757 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.269934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16268baf-fbb7-42e6-89ff-eea4d0698757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.270203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16268baf-fbb7-42e6-89ff-eea4d0698757 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.270836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16268baf-fbb7-42e6-89ff-eea4d0698757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.272447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16268baf-fbb7-42e6-89ff-eea4d0698757 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.283594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1195/2396] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:44:36.287923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.298357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536691c-8f57-49e7-a8a5-657fd0c12aa7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.303357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.304000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.304281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.304553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] PATH_INFO: `/v3/projects/0ac85b7a825f4628a68ab455dfc99072/users/85d7459f3c4443af91f30892db1d8b5d/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.319000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ac85b7a825f4628a68ab455dfc99072, user_id=85d7459f3c4443af91f30892db1d8b5d, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.321691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.334997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1202/2397] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:44:36 2022] PUT /identity/v3/projects/0ac85b7a825f4628a68ab455dfc99072/users/85d7459f3c4443af91f30892db1d8b5d/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:44:36.345306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.345620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.345916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.373256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] MFA Rules not processed for user `85d7459f3c4443af91f30892db1d8b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:36.374514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:36.437472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1196/2398] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:44:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:44:36.448569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:36.450360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:36.509597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41299beb-0d33-4e93-af28-1f23a12657c2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:36.513410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81064da-5aab-40aa-be8d-cc707fe57990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:36.514019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81064da-5aab-40aa-be8d-cc707fe57990 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:36.514307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81064da-5aab-40aa-be8d-cc707fe57990 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:36.514582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81064da-5aab-40aa-be8d-cc707fe57990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:36.529944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81064da-5aab-40aa-be8d-cc707fe57990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:36.531628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81064da-5aab-40aa-be8d-cc707fe57990 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:36.542218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1203/2399] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:40.614942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:44:40.617557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:40.677962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:40.717399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d569f-277b-49ef-bb82-2c8d6b7da653 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:44:40.723722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:44:40.724492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:40.724915 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:40.725276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:40.727416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:40.742166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:44:40.743693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:44:40.754704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1197/2400] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:44:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:44:46.537575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=57,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:50.750605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=16 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:44:59.164172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:44:59.164628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:44:59.165169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:44:59.193314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] MFA Rules not processed for user `06a40ad8ffc847028888ecda6221fcf4`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:44:59.194683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:44:59.254784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1204/2401] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:44:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:00.103177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:00.104665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:00.196658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84476ee3-e186-431b-824e-f2911100d74b service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:00.201299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:00.201965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:00.202279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:00.202638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] PATH_INFO: `/v3/users/9aa9db920f10441bb41a95feca5585f2` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:00.204020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aa9db920f10441bb41a95feca5585f2)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:00.206042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:00.268955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aa9db920f10441bb41a95feca5585f2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.276543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aa9db920f10441bb41a95feca5585f2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.289323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aa9db920f10441bb41a95feca5585f2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.290077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aa9db920f10441bb41a95feca5585f2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.290689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aa9db920f10441bb41a95feca5585f2'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.304781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1198/2402] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:45:00 2022] DELETE /identity/v3/users/9aa9db920f10441bb41a95feca5585f2 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:45:00.503136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:00.523345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316dd9e-69e6-4bbe-9969-22a2b7f0b1b0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:00.597961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:00.598646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:00.598927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:00.599234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] PATH_INFO: `/v3/projects/d8354c9cf12441b4a36af793477b80a6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:00.600411 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8354c9cf12441b4a36af793477b80a6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:00.602406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:00.651920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8354c9cf12441b4a36af793477b80a6', 'request_id': 'req-475391d3-feee-4f22-9f0f-26fd40d6566e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.660590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8354c9cf12441b4a36af793477b80a6', 'request_id': 'req-475391d3-feee-4f22-9f0f-26fd40d6566e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.666921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8354c9cf12441b4a36af793477b80a6', 'request_id': 'req-475391d3-feee-4f22-9f0f-26fd40d6566e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.679430 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] The token cache is being invalidate because project d8354c9cf12441b4a36af793477b80a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:45:00.679719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.680366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-475391d3-feee-4f22-9f0f-26fd40d6566e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:00.681899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1205/2403] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:45:00 2022] DELETE /identity/v3/projects/d8354c9cf12441b4a36af793477b80a6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:45:08.711524 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:08.713072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:08.726191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba7d56-5d8e-46f8-829c-0f46ae570dd3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:08.783158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:08.783418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:08.783529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:08.783764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] PATH_INFO: `/v3/users/85d7459f3c4443af91f30892db1d8b5d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:08.784904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d7459f3c4443af91f30892db1d8b5d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:08.787032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:08.809604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:08.837315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d7459f3c4443af91f30892db1d8b5d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:08.844628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d7459f3c4443af91f30892db1d8b5d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:08.856474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d7459f3c4443af91f30892db1d8b5d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:08.857173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d7459f3c4443af91f30892db1d8b5d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:08.857808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d7459f3c4443af91f30892db1d8b5d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:08.871857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1199/2404] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:45:08 2022] DELETE /identity/v3/users/85d7459f3c4443af91f30892db1d8b5d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:45:08.877409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:08.877951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:08.878050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:08.897256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:08.898518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:08.929773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:08.960819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1206/2405] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:45:08.970702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:08.972140 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:09.036979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f310dc18-6140-48a9-b56a-e0e6581f1f50 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.041300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee43e2f-1ca8-426f-bf4d-bff3ff201f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.041937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43e2f-1ca8-426f-bf4d-bff3ff201f78 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.042212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43e2f-1ca8-426f-bf4d-bff3ff201f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.042484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee43e2f-1ca8-426f-bf4d-bff3ff201f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.052816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee43e2f-1ca8-426f-bf4d-bff3ff201f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.054289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee43e2f-1ca8-426f-bf4d-bff3ff201f78 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.064345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1200/2406] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:09.361214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.363684 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:09.378775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84ec8e-5016-4dd8-8c10-16788e5c4e08 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.387910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.389169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.389913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.390537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] PATH_INFO: `/v3/projects/0ac85b7a825f4628a68ab455dfc99072` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.392721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ac85b7a825f4628a68ab455dfc99072)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.396147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.448407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ac85b7a825f4628a68ab455dfc99072', 'request_id': 'req-7301af55-1cf4-448d-b506-e8e286635674'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:09.456147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ac85b7a825f4628a68ab455dfc99072', 'request_id': 'req-7301af55-1cf4-448d-b506-e8e286635674'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:09.461996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ac85b7a825f4628a68ab455dfc99072', 'request_id': 'req-7301af55-1cf4-448d-b506-e8e286635674'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:09.474164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] The token cache is being invalidate because project 0ac85b7a825f4628a68ab455dfc99072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:45:09.474357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:09.475053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-7301af55-1cf4-448d-b506-e8e286635674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:45:09.476639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1207/2407] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:45:09 2022] DELETE /identity/v3/projects/0ac85b7a825f4628a68ab455dfc99072 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:45:09.482443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.491165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.491450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.511660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:09.512874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:09.580195 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1201/2408] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:09.588449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.588777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.589064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.622981 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:09.624325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:09.632379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1208/2409] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:09.636741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.647358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a28bc-df24-46ad-880b-13741ad755ea None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.652125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.652733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.653011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.653287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.654031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:45:09.654334 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.656629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.676447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1202/2410] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:45:09.687211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.702607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163c9cb-ae45-4348-98ee-c1ab7b796fdb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.711543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.719010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.719010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.719010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.719010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.719010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.751218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1209/2411] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:45:09 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:45:09.755314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.766531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb73e4-9a1c-4b8d-81d9-183c27de828f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.795174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:09.828375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.828982 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.829264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.829567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.830199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.832133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.857302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1203/2412] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:45:09 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:45:09.861406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.873100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716fbf9-85d2-400c-98ac-9f55b683eb93 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.878327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.879054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.879214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.879488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.880138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.881787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.892847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1210/2413] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:45:09.897077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.907926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fa7b-19f0-4f25-81d5-8ff7a067011d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.912598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2dd2e-987e-4337-94c7-0ccdc1611d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.913203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2dd2e-987e-4337-94c7-0ccdc1611d62 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.913531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2dd2e-987e-4337-94c7-0ccdc1611d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.913830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2dd2e-987e-4337-94c7-0ccdc1611d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.914478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2dd2e-987e-4337-94c7-0ccdc1611d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.916094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2dd2e-987e-4337-94c7-0ccdc1611d62 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.927392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1204/2414] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:45:09.931775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:09.942544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56850abf-9c78-4489-983d-8c855aee3f00 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:09.947410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:09.948069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.948348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.948619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] PATH_INFO: `/v3/projects/97b7e95dd9dd467791a0f76f54287ae4/users/677db3483143470a965cc36a2add51ee/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:09.964426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b7e95dd9dd467791a0f76f54287ae4, user_id=677db3483143470a965cc36a2add51ee, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:09.967114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:09.980500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1211/2415] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:45:09 2022] PUT /identity/v3/projects/97b7e95dd9dd467791a0f76f54287ae4/users/677db3483143470a965cc36a2add51ee/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:45:09.990864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039937b7-5475-4b2b-bbb3-7a6ec79d976b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:09.991149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039937b7-5475-4b2b-bbb3-7a6ec79d976b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:09.991427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039937b7-5475-4b2b-bbb3-7a6ec79d976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:10.011261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-039937b7-5475-4b2b-bbb3-7a6ec79d976b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:10.012505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-039937b7-5475-4b2b-bbb3-7a6ec79d976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:10.079092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1205/2416] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:10.089015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:10.090775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:10.151698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb9867-780c-427a-8d71-a13a654ce3ca admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:10.155539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:10.156189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:10.156474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:10.156747 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:10.166567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:10.168028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:10.172024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:10.179505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1212/2417] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:15.156663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.157962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.158318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.190449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] MFA Rules not processed for user `677db3483143470a965cc36a2add51ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:15.191618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:15.281131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1206/2418] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:15.285837 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:15.299555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c96eb-5ae3-4791-bfb2-327e5909b24c service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:15.304462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:15.305564 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.306086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.306413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.307123 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:15.309108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:15.347659 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1213/2419] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:45:15 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:45:15.349201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:15.360898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c958eb6-af61-411b-9cfe-a42fa18c9dc1 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:15.399421 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:15.428335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:15.428957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.429280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.429537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.430181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:15.432172 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:15.463618 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1207/2420] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:45:15 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:45:15.464667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:15.479868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1d46b-0fb8-41c5-b6ce-73141296c000 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:15.486338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:15.487040 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.487610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.488092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.488821 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:15.490571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:15.507469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:15.507879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1214/2421] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:45:15.519029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373916ab-6f01-4909-9c6a-fded2fca8fb6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:15.526134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:15.526811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.527091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.527358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] PATH_INFO: `/v3/projects/721b545ba70644cca4c4ad15f09cc5e3/users/538bac0f4c2c46e58c7e25e664256199/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.544703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721b545ba70644cca4c4ad15f09cc5e3, user_id=538bac0f4c2c46e58c7e25e664256199, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:15.548076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:15.563120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1208/2422] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:45:15 2022] PUT /identity/v3/projects/721b545ba70644cca4c4ad15f09cc5e3/users/538bac0f4c2c46e58c7e25e664256199/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:45:15.567169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:15.578011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f668-9e9f-4f5b-b11e-535ae786adbc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:15.637003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd06c38-240c-45a3-899c-c902052aec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:15.637727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06c38-240c-45a3-899c-c902052aec83 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.638030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06c38-240c-45a3-899c-c902052aec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.638297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd06c38-240c-45a3-899c-c902052aec83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.638960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd06c38-240c-45a3-899c-c902052aec83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:15.640619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd06c38-240c-45a3-899c-c902052aec83 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:15.654311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1215/2423] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:45:15.655548 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:15.667157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d5da-7862-486e-9ce6-527ba67d0036 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:15.672637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:15.673086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:15.673395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:15.673677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] PATH_INFO: `/v3/projects/721b545ba70644cca4c4ad15f09cc5e3/users/538bac0f4c2c46e58c7e25e664256199/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:15.675634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=721b545ba70644cca4c4ad15f09cc5e3, user_id=538bac0f4c2c46e58c7e25e664256199, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:15.678345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:15.690773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1209/2424] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:45:15 2022] PUT /identity/v3/projects/721b545ba70644cca4c4ad15f09cc5e3/users/538bac0f4c2c46e58c7e25e664256199/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:45:20.287733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657d0f-11a2-45dd-a198-b0ed9a98cfa1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:20.288271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657d0f-11a2-45dd-a198-b0ed9a98cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:20.288372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35657d0f-11a2-45dd-a198-b0ed9a98cfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:20.319910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-35657d0f-11a2-45dd-a198-b0ed9a98cfa1 None None] MFA Rules not processed for user `538bac0f4c2c46e58c7e25e664256199`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:20.330767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-35657d0f-11a2-45dd-a198-b0ed9a98cfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:20.439651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1216/2425] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:20.454886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:20.456688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:20.556464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de5628-d243-4f2b-809b-1886e4e0c913 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:20.567212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebeaee-fb00-4d07-9a71-3f71a8252fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:20.567948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeaee-fb00-4d07-9a71-3f71a8252fc5 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:20.568234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeaee-fb00-4d07-9a71-3f71a8252fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:20.568531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeaee-fb00-4d07-9a71-3f71a8252fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:20.636390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebeaee-fb00-4d07-9a71-3f71a8252fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:20.638058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ebeaee-fb00-4d07-9a71-3f71a8252fc5 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:20.648567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1210/2426] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:45:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:21.074300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47437a0-2e01-420a-8823-83578ab813f8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:21.074641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47437a0-2e01-420a-8823-83578ab813f8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:21.075360 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47437a0-2e01-420a-8823-83578ab813f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:21.099205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f47437a0-2e01-420a-8823-83578ab813f8 None None] MFA Rules not processed for user `7b153ae4d44c452689451adf19c680b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:21.100775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f47437a0-2e01-420a-8823-83578ab813f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:21.163253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:21.183863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1217/2427] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:22.075910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:22.077029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:22.077029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:22.097065 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] MFA Rules not processed for user `677db3483143470a965cc36a2add51ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:22.098234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:22.105791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1211/2428] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:30.950091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede1f2-4f0a-4845-bd32-f23e7627f9d8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:30.950592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede1f2-4f0a-4845-bd32-f23e7627f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:30.950707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ede1f2-4f0a-4845-bd32-f23e7627f9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:30.972384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-25ede1f2-4f0a-4845-bd32-f23e7627f9d8 None None] MFA Rules not processed for user `d90000dd2b094facafada1ada1c8573f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:45:30.973647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-25ede1f2-4f0a-4845-bd32-f23e7627f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:31.036461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1218/2429] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:45:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:45:32.091358 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:41.029131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=29 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:45:47.329623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:45:47.331170 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:45:47.388806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152da34-72b3-4a96-a868-6648ec7492e9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:45:47.392485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:45:47.393301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:45:47.393826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:45:47.394293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:45:47.406233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:45:47.407745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:45:47.417844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1212/2430] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:45:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:45:57.413306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=26 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:13.623200 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:13.623695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:13.623803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:13.648550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:13.649828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:13.715423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1219/2431] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:46:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:13.768199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:13.770044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:13.861308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10011a2-6ed1-4b71-a37f-0d976d051176 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:13.866455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:13.867069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:13.867353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:13.867628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:13.882630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:13.884412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:13.894018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1213/2432] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:46:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:46:17.179477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:17.190771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e73e9-9dfb-4064-a8c7-892f3ca1038a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:17.196369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:17.197072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:17.197451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:17.197795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:17.199624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:17.218358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:17.222320 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:17.232857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1220/2433] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:18.659900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:18.670886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c345252-100d-4da2-b8fe-cbbaf00affea service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:18.674750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:18.675420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:18.675789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:18.676131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:18.678141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:18.693923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:18.695460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:18.710314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1214/2434] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:26.888530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:26.899891 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e746a-9618-4c7e-b112-3f38b4c94137 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:26.905343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:26.905962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:26.906246 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:26.906521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:26.908260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:26.966818 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:26.968395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:26.977418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1221/2435] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:28.339929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:28.349933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e317a-c4a7-46bc-9587-07de6953ddcf service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:28.353860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:28.355595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:28.355979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:28.356342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:28.358810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:28.471489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:28.473529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8119ab-529c-489e-8d95-93b6148391bb service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:28.488625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1215/2436] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:30.341917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:30.344432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:30.415198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290af160-44cb-4498-b92f-61776bc4a525 service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:30.419570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:30.420234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:30.420515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:30.420960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:30.424014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:30.440055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:30.441940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239689bd-fefc-4381-a1b0-8227dec05a99 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:30.453913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1222/2437] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:32.372107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6655-f1a2-4406-b5d4-0daebe83d4d2 None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:32.372706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6655-f1a2-4406-b5d4-0daebe83d4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:32.372706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b6655-f1a2-4406-b5d4-0daebe83d4d2 None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:32.376681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1216/2438] 10.222.0.67 () {54 vars in 921 bytes} [Mon Aug 29 23:46:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:46:32.407677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:32.407677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:32.408321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:32.442179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:32.449672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.457704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6655-f1a2-4406-b5d4-0daebe83d4d2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:32.460116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-af0b6655-f1a2-4406-b5d4-0daebe83d4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.482804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b6655-f1a2-4406-b5d4-0daebe83d4d2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:32.487971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:32.489150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:32.490049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:32.490329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] PATH_INFO: `/v3/users/7b153ae4d44c452689451adf19c680b8` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:32.492150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b153ae4d44c452689451adf19c680b8)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:32.495146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:32.507145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:32.566121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1223/2439] 10.222.0.67 () {58 vars in 1018 bytes} [Mon Aug 29 23:46:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:32.571944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b153ae4d44c452689451adf19c680b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:32.581121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:32.583629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.585931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b153ae4d44c452689451adf19c680b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:32.595327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:32.604265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f99ae7-a612-4850-8cb7-3d86b8a9f811 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:32.609400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b153ae4d44c452689451adf19c680b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:32.611696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b153ae4d44c452689451adf19c680b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:32.613083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:32.613705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7a3176ec-1d8b-4498-a21a-5676039b00b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b153ae4d44c452689451adf19c680b8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:32.614324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:32.614607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:32.614882 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:32.616655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.634019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1217/2440] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:32 2022] DELETE /identity/v3/users/7b153ae4d44c452689451adf19c680b8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:32.634344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:32.634753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:32.650217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1224/2441] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:46:32.767249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:32.768587 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:32.769098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:32.794409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:32.795662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.845767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:32.848271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.878912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4123d3f-648b-4c1d-9504-a506e21c208a service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:32.907621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1218/2442] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:46:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:32.921671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:32.923701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:32.961432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:32.961432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:32.961719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:32.962025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] PATH_INFO: `/v3/projects/52f5111c66c540b0bfc9fb383621e1b9` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:32.963376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f5111c66c540b0bfc9fb383621e1b9)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:32.965422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.010692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2d69a-30d6-4d80-ab5a-80a188ee29d5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.014942 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f5111c66c540b0bfc9fb383621e1b9', 'request_id': 'req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:33.022546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f5111c66c540b0bfc9fb383621e1b9', 'request_id': 'req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:33.028594 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f5111c66c540b0bfc9fb383621e1b9', 'request_id': 'req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:33.039774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] The token cache is being invalidate because project 52f5111c66c540b0bfc9fb383621e1b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:33.040064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:33.040713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f53d3e54-8ac2-456a-b7b6-139dba2b3d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:33.042284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1225/2443] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:32 2022] DELETE /identity/v3/projects/52f5111c66c540b0bfc9fb383621e1b9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:33.047644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2c5ce-e001-40e1-b70b-48b6bfae332f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.047932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2c5ce-e001-40e1-b70b-48b6bfae332f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.048204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2c5ce-e001-40e1-b70b-48b6bfae332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.069901 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-efb2c5ce-e001-40e1-b70b-48b6bfae332f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:33.071104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-efb2c5ce-e001-40e1-b70b-48b6bfae332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:33.074847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.075460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.075739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.076009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.077892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:33.110580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:33.115628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:33.142319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1226/2444] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:46:33.150586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.151159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.151622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.151988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.152945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.163879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1219/2445] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:46:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:46:33.173473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:33.174697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:33.182686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1227/2446] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:33.187219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:33.201639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819cdcb-e102-4890-86b7-81125dc8bb6c service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.210026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.210861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.211324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.211780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.212530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:33.212925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.214969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.228911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1220/2447] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:46:33.233983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:33.244787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f35f30-bd62-4f7c-b3f9-5305bb80e905 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.250801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.251977 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.252111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.252567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.253874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.255938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.303470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:33.313534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1228/2448] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:33 2022] POST /identity/v3/projects => generated 399 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:46:33.320490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0e36-e267-4fb8-9b50-5b7f1e067ca9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.473485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.474299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.474515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.474865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.475528 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.477789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.521547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1221/2449] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:33 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:33.523416 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:33.535635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b27a04-7737-4723-8633-9b0473a4598c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.554302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.555084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.555454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.555820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.556569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.558426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.581261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1229/2450] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:33.585304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:33.600523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fbb33-894d-4fae-a5d3-4f4430c299c7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.609189 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde24e5f-5eb7-48a0-9b1b-b0f1639896ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.610173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde24e5f-5eb7-48a0-9b1b-b0f1639896ef admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.610588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde24e5f-5eb7-48a0-9b1b-b0f1639896ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.610877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde24e5f-5eb7-48a0-9b1b-b0f1639896ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.611972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde24e5f-5eb7-48a0-9b1b-b0f1639896ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.613926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde24e5f-5eb7-48a0-9b1b-b0f1639896ef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.660234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1222/2451] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:33.664446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:33.682529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0355bf2-0124-4952-9ce3-4df2214c7212 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:33.697528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:33.698453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.698906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.699343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] PATH_INFO: `/v3/projects/f0f522c4b02b4675873cd5cb2ada3dfd/users/aecb318723294047b69ad54a960b154c/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.717172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f522c4b02b4675873cd5cb2ada3dfd, user_id=aecb318723294047b69ad54a960b154c, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:33.719902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:33.739840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1230/2452] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:33 2022] PUT /identity/v3/projects/f0f522c4b02b4675873cd5cb2ada3dfd/users/aecb318723294047b69ad54a960b154c/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:33.755983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:33.756271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:33.756612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:33.800877 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] MFA Rules not processed for user `aecb318723294047b69ad54a960b154c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:33.802327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:33.889077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1223/2453] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:33.893580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.001582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43839a2-68ef-4bfc-a926-b43ef0f3bef3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.006484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.007221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.007503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.007772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.008464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.010397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.052953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1231/2454] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:33 2022] POST /identity/v3/projects => generated 405 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:34.054016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.067494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dea02e-299f-4928-bab6-b3c9c8e357bc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.109125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:34.158793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.159416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.159717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.160001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.160657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.162995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.197023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1224/2455] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:34 2022] POST /identity/v3/users => generated 309 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:34.199398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.213535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6b156-b810-45cc-8763-ad61429dd8ce admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.218726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.219398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.219688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.220033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.220607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.222298 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.235880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1232/2456] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:34.239285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.250341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2f031-2c63-46da-90b6-827c2c22bd3a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.258409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.259092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.259363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.259639 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] PATH_INFO: `/v3/projects/210a11f3fc4646449ea09c8d63321bd7/users/265487cc79954444b97a9015a8aea458/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.282745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=210a11f3fc4646449ea09c8d63321bd7, user_id=265487cc79954444b97a9015a8aea458, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.286368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.305849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1225/2457] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:34 2022] PUT /identity/v3/projects/210a11f3fc4646449ea09c8d63321bd7/users/265487cc79954444b97a9015a8aea458/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:34.307561 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.323351 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b50b7-ed75-4f71-8860-db29dad0e214 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.381014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:34.391340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f28116-d058-438d-96fd-8ace7400dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.392008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28116-d058-438d-96fd-8ace7400dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.392293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28116-d058-438d-96fd-8ace7400dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.392562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f28116-d058-438d-96fd-8ace7400dec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.393212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f28116-d058-438d-96fd-8ace7400dec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.394846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f28116-d058-438d-96fd-8ace7400dec9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.407034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1233/2458] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:34.411217 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.422477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17d1eb-941b-44c7-9a0f-538191f83a4e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.427164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.427846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.428121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.428388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] PATH_INFO: `/v3/projects/210a11f3fc4646449ea09c8d63321bd7/users/265487cc79954444b97a9015a8aea458/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.430321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=210a11f3fc4646449ea09c8d63321bd7, user_id=265487cc79954444b97a9015a8aea458, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.432981 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.448164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1226/2459] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:34 2022] PUT /identity/v3/projects/210a11f3fc4646449ea09c8d63321bd7/users/265487cc79954444b97a9015a8aea458/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:34.460604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.460886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.461161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.490906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] MFA Rules not processed for user `265487cc79954444b97a9015a8aea458`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:34.492140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:34.575164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1234/2460] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:34 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:34.588336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.590300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:34.655219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7462be-2532-4549-96dc-03539561bd11 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.659166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236804e-c0e5-41e8-9973-f6c57eeb07f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.659860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236804e-c0e5-41e8-9973-f6c57eeb07f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.660202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236804e-c0e5-41e8-9973-f6c57eeb07f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.660540 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236804e-c0e5-41e8-9973-f6c57eeb07f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.671537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236804e-c0e5-41e8-9973-f6c57eeb07f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.673131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236804e-c0e5-41e8-9973-f6c57eeb07f5 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:34.683758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1227/2461] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:34 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:34.841432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:34.931784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4bf5e-ef6a-4401-a4fb-d4ff8b15b2a9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:34.936359 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:34.936999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:34.937277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:34.937575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] PATH_INFO: `/v3/users/aecb318723294047b69ad54a960b154c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:34.938702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecb318723294047b69ad54a960b154c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:34.942343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:35.003090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecb318723294047b69ad54a960b154c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.012959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecb318723294047b69ad54a960b154c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.026061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecb318723294047b69ad54a960b154c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.026895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecb318723294047b69ad54a960b154c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.045746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecb318723294047b69ad54a960b154c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.047544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:35.054060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1235/2462] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:34 2022] DELETE /identity/v3/users/aecb318723294047b69ad54a960b154c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:35.058823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:35.059109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:35.059411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:35.087078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:35.088475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:35.161543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1228/2463] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:46:35.171951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:35.173546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:35.241616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9968d6f8-60c7-405c-bc65-0b8767c06d70 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:35.245269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:35.245911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:35.246191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:35.246614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:35.256633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:35.258141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:35.271240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1236/2464] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:35.583692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:35.585293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:35.613233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977db1e-474f-43af-9fd5-e269eaa448ad None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:35.620201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:35.620945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:35.621304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:35.621609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] PATH_INFO: `/v3/projects/f0f522c4b02b4675873cd5cb2ada3dfd` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:35.622810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f522c4b02b4675873cd5cb2ada3dfd)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:35.625179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:35.644764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:35.682758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f522c4b02b4675873cd5cb2ada3dfd', 'request_id': 'req-49be1a0f-75f9-4cc0-962f-275ddaf071aa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.692173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f522c4b02b4675873cd5cb2ada3dfd', 'request_id': 'req-49be1a0f-75f9-4cc0-962f-275ddaf071aa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.699058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f522c4b02b4675873cd5cb2ada3dfd', 'request_id': 'req-49be1a0f-75f9-4cc0-962f-275ddaf071aa'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.711933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] The token cache is being invalidate because project f0f522c4b02b4675873cd5cb2ada3dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:35.712436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.712891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.714469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1229/2465] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:35 2022] DELETE /identity/v3/projects/f0f522c4b02b4675873cd5cb2ada3dfd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:35.719163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:35.729407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a5bd-6f50-42dc-b7cd-940f21d71998 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:35.794541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:35.795370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:35.795710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:35.796046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] PATH_INFO: `/v3/users/265487cc79954444b97a9015a8aea458` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:35.797248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265487cc79954444b97a9015a8aea458)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:35.799700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:35.854439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265487cc79954444b97a9015a8aea458'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.865047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265487cc79954444b97a9015a8aea458'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.885080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265487cc79954444b97a9015a8aea458'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.886255 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265487cc79954444b97a9015a8aea458'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.902899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-78ccdf70-5304-41c2-88e0-ae75ceebb8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265487cc79954444b97a9015a8aea458'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:35.913768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1237/2466] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:35 2022] DELETE /identity/v3/users/265487cc79954444b97a9015a8aea458 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:46:36.324953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:36.326492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:36.348433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be1a0f-75f9-4cc0-962f-275ddaf071aa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:36.429995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:36.430791 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.431146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.431493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] PATH_INFO: `/v3/projects/210a11f3fc4646449ea09c8d63321bd7` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.432783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=210a11f3fc4646449ea09c8d63321bd7)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:36.434855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:36.490393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '210a11f3fc4646449ea09c8d63321bd7', 'request_id': 'req-4b1e979c-5a28-4011-90c2-49dec53d62b3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:36.500345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '210a11f3fc4646449ea09c8d63321bd7', 'request_id': 'req-4b1e979c-5a28-4011-90c2-49dec53d62b3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:36.506828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '210a11f3fc4646449ea09c8d63321bd7', 'request_id': 'req-4b1e979c-5a28-4011-90c2-49dec53d62b3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:36.519485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] The token cache is being invalidate because project 210a11f3fc4646449ea09c8d63321bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:36.519796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:36.520448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-4b1e979c-5a28-4011-90c2-49dec53d62b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:36.522097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1230/2467] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:36 2022] DELETE /identity/v3/projects/210a11f3fc4646449ea09c8d63321bd7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:36.527178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.527722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.528001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.560647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:36.561984 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:36.576911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:36.632710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1238/2468] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:36.641234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.641911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.642166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.664456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:36.665743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:36.676492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1231/2469] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:36.680926 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:36.696323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a91a-fc9a-433d-94f6-ab575ba4f073 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:36.707054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:36.707961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.708240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.708619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.709436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:36.709814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:36.711697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:36.724986 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1239/2470] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:46:36.729475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:36.739199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b23d4-3fb1-4575-99c7-f927ef1a1643 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:36.744199 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050790-f749-4338-92c4-24179780131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:36.744623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050790-f749-4338-92c4-24179780131a admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.744907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050790-f749-4338-92c4-24179780131a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.745174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95050790-f749-4338-92c4-24179780131a admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.745861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050790-f749-4338-92c4-24179780131a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:36.747775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95050790-f749-4338-92c4-24179780131a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:36.781282 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1232/2471] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:36 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:36.785940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:36.796697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f60f63-3063-411a-a0be-9866f0d88a5e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:36.886389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:36.887175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.887567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.887944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.888744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:36.891294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:36.916148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1240/2472] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:36 2022] POST /identity/v3/users => generated 303 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:36.920567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050790-f749-4338-92c4-24179780131a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:36.930968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95050790-f749-4338-92c4-24179780131a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:36.936182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:36.936789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.937063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.937326 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.937993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:36.939593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:36.941569 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:36.959284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1233/2473] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:36.959522 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:36.969810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635228f-388c-4d3e-ad59-d007fe860424 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:36.976107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41a887-483a-4268-8137-5da22b1e389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:36.976809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41a887-483a-4268-8137-5da22b1e389b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:36.977099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41a887-483a-4268-8137-5da22b1e389b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:36.977388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41a887-483a-4268-8137-5da22b1e389b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:36.978128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41a887-483a-4268-8137-5da22b1e389b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:36.979992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41a887-483a-4268-8137-5da22b1e389b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:36.992706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1241/2474] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:36.997677 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:37.010820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd754d2-f788-4207-ab76-97a99317aa1e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:37.029519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:37.030209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:37.030492 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:37.030766 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] PATH_INFO: `/v3/projects/0819f7705bd84f399745142adc2ddb0a/users/4861bda4fce74b5e8219d159a27e028f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:37.048100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0819f7705bd84f399745142adc2ddb0a, user_id=4861bda4fce74b5e8219d159a27e028f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:37.051185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:37.073159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1234/2475] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:36 2022] PUT /identity/v3/projects/0819f7705bd84f399745142adc2ddb0a/users/4861bda4fce74b5e8219d159a27e028f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:37.078869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4208-6874-423e-82fe-df0ffe108157 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:37.079161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4208-6874-423e-82fe-df0ffe108157 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:37.079449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b4208-6874-423e-82fe-df0ffe108157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:37.100547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5c2b4208-6874-423e-82fe-df0ffe108157 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:37.101822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5c2b4208-6874-423e-82fe-df0ffe108157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:37.177023 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1242/2476] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:37.186993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:37.188762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:37.269400 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd0a90-f102-41dd-8b34-ab3e1582177b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:37.272583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:37.273386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:37.273910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:37.274284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:37.297985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:37.299703 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:37.312701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1235/2477] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:46:38.125183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.125811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.125811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.164737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] MFA Rules not processed for user `4861bda4fce74b5e8219d159a27e028f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:38.166120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:38.193973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:38.276933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1243/2478] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:38 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:38.282235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:38.294943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6bc23-4702-4e20-a242-0c98ec4cc376 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:38.309811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:38.313110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.313498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.313845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.314669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:38.325561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:38.387122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1236/2479] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:38 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:46:38.392253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:38.406872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889019-19bb-4ab2-b665-70dea46e8905 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:38.525916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:38.526702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.526988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.527262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.527914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:38.529943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:38.569380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1244/2480] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:38 2022] POST /identity/v3/users => generated 309 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:46:38.570614 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:38.582740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587b9ba-b5ca-4130-ba2c-c7cd8e191c2d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:38.588635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:38.589543 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.589833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.590110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.591482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:38.592430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:38.607922 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1237/2481] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:38.609101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:38.621395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883d7d-9a83-4dd0-b487-98606cf7c148 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:38.634001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:38.634691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.634974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.635249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] PATH_INFO: `/v3/projects/3fffc64b3196464bac83ad6c6a5be17d/users/b08d914fb7ff419195c00c7f5f6bc3dc/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.657436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fffc64b3196464bac83ad6c6a5be17d, user_id=b08d914fb7ff419195c00c7f5f6bc3dc, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:38.660085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:38.684957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1245/2482] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:38 2022] PUT /identity/v3/projects/3fffc64b3196464bac83ad6c6a5be17d/users/b08d914fb7ff419195c00c7f5f6bc3dc/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:38.686806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:38.697379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aea214-5d67-497b-a3e3-8b993c7b6c6a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:38.785219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c880277-2cab-4bbb-9921-450638350a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:38.786063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c880277-2cab-4bbb-9921-450638350a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.786420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c880277-2cab-4bbb-9921-450638350a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.786834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c880277-2cab-4bbb-9921-450638350a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.787678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c880277-2cab-4bbb-9921-450638350a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:38.790013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c880277-2cab-4bbb-9921-450638350a7e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:38.803000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1238/2483] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:38.808849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:38.820741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40443103-07f4-4160-9dc8-c3bda3cb6c3a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:38.825917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:38.826722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:38.827073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:38.827420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] PATH_INFO: `/v3/projects/3fffc64b3196464bac83ad6c6a5be17d/users/b08d914fb7ff419195c00c7f5f6bc3dc/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:38.830129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fffc64b3196464bac83ad6c6a5be17d, user_id=b08d914fb7ff419195c00c7f5f6bc3dc, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:38.833828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:38.846193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1246/2484] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:38 2022] PUT /identity/v3/projects/3fffc64b3196464bac83ad6c6a5be17d/users/b08d914fb7ff419195c00c7f5f6bc3dc/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:46:39.690375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:39.691188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:39.691188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:39.757936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] MFA Rules not processed for user `b08d914fb7ff419195c00c7f5f6bc3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:39.759376 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:39.813200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:39.919711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1239/2485] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:39 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:41.170810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:41.242328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3eca89-0540-4669-a657-938eb186c139 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:41.246983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:41.247609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:41.248466 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:41.248743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] PATH_INFO: `/v3/users/4861bda4fce74b5e8219d159a27e028f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:41.249910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4861bda4fce74b5e8219d159a27e028f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:41.251876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:41.262012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:41.300321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4861bda4fce74b5e8219d159a27e028f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.307185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4861bda4fce74b5e8219d159a27e028f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.315295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4861bda4fce74b5e8219d159a27e028f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.316350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4861bda4fce74b5e8219d159a27e028f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.329112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4861bda4fce74b5e8219d159a27e028f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.335314 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1247/2486] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:41 2022] DELETE /identity/v3/users/4861bda4fce74b5e8219d159a27e028f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:41.523362 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:41.536574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b32f-b6a6-4630-85e0-2f371390c131 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:41.598028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:41.598658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:41.598942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:41.599211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] PATH_INFO: `/v3/projects/0819f7705bd84f399745142adc2ddb0a` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:41.600337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0819f7705bd84f399745142adc2ddb0a)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:41.602311 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:41.648573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0819f7705bd84f399745142adc2ddb0a', 'request_id': 'req-3e9991c9-c048-4745-94e9-43dcd4f25dbe'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.655208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0819f7705bd84f399745142adc2ddb0a', 'request_id': 'req-3e9991c9-c048-4745-94e9-43dcd4f25dbe'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.660713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0819f7705bd84f399745142adc2ddb0a', 'request_id': 'req-3e9991c9-c048-4745-94e9-43dcd4f25dbe'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.671722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] The token cache is being invalidate because project 0819f7705bd84f399745142adc2ddb0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:41.672008 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.672640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.674224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1240/2487] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:41 2022] DELETE /identity/v3/projects/0819f7705bd84f399745142adc2ddb0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:41.678357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:41.679759 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:41.696508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201bf9d-dd03-4354-b984-cf6ccdd5c2e5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:41.753637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:41.754273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:41.754537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:41.754806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] PATH_INFO: `/v3/users/b08d914fb7ff419195c00c7f5f6bc3dc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:41.755914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08d914fb7ff419195c00c7f5f6bc3dc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:41.757854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:41.804089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08d914fb7ff419195c00c7f5f6bc3dc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.811533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08d914fb7ff419195c00c7f5f6bc3dc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.819253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08d914fb7ff419195c00c7f5f6bc3dc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.819892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08d914fb7ff419195c00c7f5f6bc3dc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.831512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-14fe5d34-8d3a-4125-96d1-d06264a32f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08d914fb7ff419195c00c7f5f6bc3dc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:41.837550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1248/2488] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:41 2022] DELETE /identity/v3/users/b08d914fb7ff419195c00c7f5f6bc3dc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:46:42.015831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.017305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:42.035899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9991c9-c048-4745-94e9-43dcd4f25dbe admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.085204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:42.095984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.096615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.096894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.097168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] PATH_INFO: `/v3/projects/3fffc64b3196464bac83ad6c6a5be17d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.098330 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fffc64b3196464bac83ad6c6a5be17d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.100247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.149630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fffc64b3196464bac83ad6c6a5be17d', 'request_id': 'req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:42.155456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fffc64b3196464bac83ad6c6a5be17d', 'request_id': 'req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:42.161196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fffc64b3196464bac83ad6c6a5be17d', 'request_id': 'req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:42.173098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] The token cache is being invalidate because project 3fffc64b3196464bac83ad6c6a5be17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:42.173407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:42.174066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9b8530fc-0a0a-4e66-b12a-71d4519ecc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:42.175568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1241/2489] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:42 2022] DELETE /identity/v3/projects/3fffc64b3196464bac83ad6c6a5be17d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:42.180472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.180965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.181097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.194622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:42.201307 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:42.203153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:42.267847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1249/2490] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:42.275684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.275968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.276245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.296950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:42.298209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:42.306216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1242/2491] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:42.310872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.320834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021314e4-4529-4705-ac39-7c1c563dd09b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.325988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.326760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.327047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.327316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.327999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:42.328302 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.330069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.345745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1250/2492] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:46:42.349736 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.360266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecd199-5721-4367-bf95-d72cfcfc689c None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.365562 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.366242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.366598 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.366937 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.367635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.370173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.400305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1243/2493] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:42.405201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.416230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95924ee5-03ea-4560-ab26-228d4a0865ab admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.482870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.483491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.483775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.484051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.484738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.486704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.509426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1251/2494] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/users => generated 291 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:42.513999 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.533731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5f0b-360d-4fca-976a-a15dec70e5f5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.541043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.541689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.541997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.542270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.542928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.544657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.556738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1244/2495] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:42.560961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.571182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58837-bca3-4b0f-bfe3-c255f85b3f57 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.576623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab9323-9174-4d93-88e9-bec14abd2ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.577226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9323-9174-4d93-88e9-bec14abd2ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.577549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9323-9174-4d93-88e9-bec14abd2ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.577825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab9323-9174-4d93-88e9-bec14abd2ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.578475 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab9323-9174-4d93-88e9-bec14abd2ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.580126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab9323-9174-4d93-88e9-bec14abd2ae6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.592467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1252/2496] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:42.596650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.607389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0799199-6529-41b3-9644-38aa5605807e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.612102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.612781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.613066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.613339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] PATH_INFO: `/v3/projects/c23a27fd5ae34fafb8f88118c0f7269a/users/1e5c3bb8cb0049798df815a0b52c2865/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.629670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c23a27fd5ae34fafb8f88118c0f7269a, user_id=1e5c3bb8cb0049798df815a0b52c2865, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.632080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.646940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1245/2497] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:42 2022] PUT /identity/v3/projects/c23a27fd5ae34fafb8f88118c0f7269a/users/1e5c3bb8cb0049798df815a0b52c2865/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:42.658426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.658717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.658989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.687996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] MFA Rules not processed for user `1e5c3bb8cb0049798df815a0b52c2865`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:42.689429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:42.756049 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1253/2498] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:42.760511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.826372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c4207-aa24-494c-aeb3-0b126ea62024 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.832143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.833211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.833530 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.833854 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.834612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.836643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.871510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1246/2499] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:42.873631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.879125 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:42.886803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f877ba-f8be-4852-919c-96f3f158a09e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.945617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.946233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.946514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.946786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.947423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.949479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:42.970961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1254/2500] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:42 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:46:42.974828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:42.981474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:42.985605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80fa1-a159-407d-8556-89463b6f838b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:42.991536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:42.992375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:42.992830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:42.993190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:42.994087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:42.995753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.007162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1247/2501] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:43.011238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.021907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb3c53-72cb-4ba5-858a-9a3184c4d6f1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.026468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.027107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.027389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.027660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] PATH_INFO: `/v3/projects/ebad0a43a28b468cb0bcf2d2f1b0a083/users/d2071c01413a48838d4ca1a3ebd9e4dc/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.042427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebad0a43a28b468cb0bcf2d2f1b0a083, user_id=d2071c01413a48838d4ca1a3ebd9e4dc, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.045156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.058095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1255/2502] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:43 2022] PUT /identity/v3/projects/ebad0a43a28b468cb0bcf2d2f1b0a083/users/d2071c01413a48838d4ca1a3ebd9e4dc/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:43.063495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.073962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0011-1d29-495e-92b9-6c15178af059 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.133773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc2a10-f206-48a6-9a6e-85b342c907b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.134368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2a10-f206-48a6-9a6e-85b342c907b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.134643 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2a10-f206-48a6-9a6e-85b342c907b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.134906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc2a10-f206-48a6-9a6e-85b342c907b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.135535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2a10-f206-48a6-9a6e-85b342c907b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.137141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc2a10-f206-48a6-9a6e-85b342c907b2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.147680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1248/2503] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:46:43.153897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.164333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a124e-1d2a-43c2-8b3a-3a0475c58f28 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.168877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.169578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.169860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.170128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] PATH_INFO: `/v3/projects/ebad0a43a28b468cb0bcf2d2f1b0a083/users/d2071c01413a48838d4ca1a3ebd9e4dc/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.172009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebad0a43a28b468cb0bcf2d2f1b0a083, user_id=d2071c01413a48838d4ca1a3ebd9e4dc, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.174764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.185907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1256/2504] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:43 2022] PUT /identity/v3/projects/ebad0a43a28b468cb0bcf2d2f1b0a083/users/d2071c01413a48838d4ca1a3ebd9e4dc/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:43.197044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.197343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.197646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.238658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] MFA Rules not processed for user `d2071c01413a48838d4ca1a3ebd9e4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:43.239964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:43.313070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1249/2505] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:43.325591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.327330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:43.387378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bffb6-619f-4bd6-b7a3-d1783d502d01 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.391111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.391721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.392001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.392275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.402253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.403718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.415427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1257/2506] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:43.742632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.751858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ad8b0-7195-4ce4-ade0-8daf0b35a2d4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.756360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2071c01413a48838d4ca1a3ebd9e4dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.756945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.757224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.757532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.758174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:43.758473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.760101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.771704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1250/2507] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:46:43.775987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.786096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450cd82-7d94-4b27-9945-756828f5511a service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.790553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2071c01413a48838d4ca1a3ebd9e4dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.791134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.791417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.791687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.792311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.794226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.821060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1258/2508] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:43 2022] POST /identity/v3/projects => generated 354 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:43.825173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.836010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7766a-9d5b-46c2-9a12-93f656d9e5f3 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.901374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2071c01413a48838d4ca1a3ebd9e4dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.901993 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.902278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.902556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.903208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:43.903516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.905647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:43.908324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:43.918685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1251/2509] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:46:43.958463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:43.970872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588f84d-7c76-495d-ad65-1d1a7301483b tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:43.975726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd2071c01413a48838d4ca1a3ebd9e4dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:43.976368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:43.976656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:43.976929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] PATH_INFO: `/v3/projects/330c689386084ae68e30fac797470de1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:43.978079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorizing `identity:delete_project(project_id=330c689386084ae68e30fac797470de1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:43.979991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:44.015386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:44.033102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330c689386084ae68e30fac797470de1', 'request_id': 'req-745cfb11-9b65-4a95-bdf0-0a4b62361200'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.040093 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330c689386084ae68e30fac797470de1', 'request_id': 'req-745cfb11-9b65-4a95-bdf0-0a4b62361200'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.045658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330c689386084ae68e30fac797470de1', 'request_id': 'req-745cfb11-9b65-4a95-bdf0-0a4b62361200'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.057214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] The token cache is being invalidate because project 330c689386084ae68e30fac797470de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:44.057531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.058182 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-745cfb11-9b65-4a95-bdf0-0a4b62361200 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.059672 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1259/2510] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:43 2022] DELETE /identity/v3/projects/330c689386084ae68e30fac797470de1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:44.254809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:44.256663 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:44.324031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e830-c7a4-4ac0-86ea-05c00ef3fc12 tempest-VolumeQuotaClassesTest-1663328576 tempest-VolumeQuotaClassesTest-1663328576-project-admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:44.384762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:44.385535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:44.385812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:44.386126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] PATH_INFO: `/v3/users/1e5c3bb8cb0049798df815a0b52c2865` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:44.387267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e5c3bb8cb0049798df815a0b52c2865)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:44.390007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:44.441021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e5c3bb8cb0049798df815a0b52c2865'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.448006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e5c3bb8cb0049798df815a0b52c2865'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.461155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e5c3bb8cb0049798df815a0b52c2865'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.461906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e5c3bb8cb0049798df815a0b52c2865'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.462512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e5c3bb8cb0049798df815a0b52c2865'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:44.476882 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1252/2511] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:44 2022] DELETE /identity/v3/users/1e5c3bb8cb0049798df815a0b52c2865 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:44.481620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:44.482206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:44.482505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:44.503833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:44.505044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:44.577287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1260/2512] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:44.587671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:44.589117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:44.623860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:44.664667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fcd36-47e1-4253-9492-98e6556bbcec admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:44.668141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:44.668756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:44.669034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:44.669302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:44.683303 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:44.684762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:44.696483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1253/2513] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:45.013327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:45.015262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:45.027631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ba602-bafb-4cc8-bcbb-32393299e2a1 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:45.044269 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:45.045649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.046014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.046294 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] PATH_INFO: `/v3/projects/c23a27fd5ae34fafb8f88118c0f7269a` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.048410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c23a27fd5ae34fafb8f88118c0f7269a)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:45.050487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:45.101773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c23a27fd5ae34fafb8f88118c0f7269a', 'request_id': 'req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.110499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c23a27fd5ae34fafb8f88118c0f7269a', 'request_id': 'req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.117025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c23a27fd5ae34fafb8f88118c0f7269a', 'request_id': 'req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.129454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] The token cache is being invalidate because project c23a27fd5ae34fafb8f88118c0f7269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:45.129795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.130458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.131993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1261/2514] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:45 2022] DELETE /identity/v3/projects/c23a27fd5ae34fafb8f88118c0f7269a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:45.138119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:45.149158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53e349-550b-4a14-8bfa-a442b4cb1445 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:45.228288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:45.229075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.229383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.229665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] PATH_INFO: `/v3/users/d2071c01413a48838d4ca1a3ebd9e4dc` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.230974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2071c01413a48838d4ca1a3ebd9e4dc)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:45.233600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:45.286592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2071c01413a48838d4ca1a3ebd9e4dc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.293700 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2071c01413a48838d4ca1a3ebd9e4dc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.306692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2071c01413a48838d4ca1a3ebd9e4dc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.307406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2071c01413a48838d4ca1a3ebd9e4dc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.308012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0b14ee72-b5cd-4072-8411-0773c062b64b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2071c01413a48838d4ca1a3ebd9e4dc'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.320555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1254/2515] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:45 2022] DELETE /identity/v3/users/d2071c01413a48838d4ca1a3ebd9e4dc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:45.603004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:45.604445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:45.619945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11529fd6-8dc6-4863-9a2d-56c10ebb52e8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:45.663397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:45.681225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:45.681886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.682165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.682433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] PATH_INFO: `/v3/projects/ebad0a43a28b468cb0bcf2d2f1b0a083` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.683545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebad0a43a28b468cb0bcf2d2f1b0a083)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:45.685469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:45.734420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'request_id': 'req-8b58f330-5db9-405f-adf3-98e5edcd2a1d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.741718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'request_id': 'req-8b58f330-5db9-405f-adf3-98e5edcd2a1d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.747553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebad0a43a28b468cb0bcf2d2f1b0a083', 'request_id': 'req-8b58f330-5db9-405f-adf3-98e5edcd2a1d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.759333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] The token cache is being invalidate because project ebad0a43a28b468cb0bcf2d2f1b0a083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:45.759620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.760305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8b58f330-5db9-405f-adf3-98e5edcd2a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:45.761842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1262/2516] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:45 2022] DELETE /identity/v3/projects/ebad0a43a28b468cb0bcf2d2f1b0a083 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:45.767438 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.767723 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.768000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.788588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:45.790124 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:45.833087 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:45.859596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1255/2517] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:45.868237 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.868603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.868946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.894106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:45.895441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:45.904007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1263/2518] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:45.908568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:45.918360 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e5a5c-075c-4429-9ad7-b85002a3838f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:45.922997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:45.923607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.923885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.924158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.924823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:45.925108 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:45.926761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:45.945073 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1256/2519] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:46:45.946466 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:45.956938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621d762-d5db-4fe4-8430-728d1b90090f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:45.962605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:45.963229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:45.963693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:45.963973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:45.964710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:45.966859 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:45.996201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1264/2520] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:45 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:46:46.000780 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.012616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df1dba-6597-4cc7-b29a-b571ce3c4ec0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.072541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.073147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.073460 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.073735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.074391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.077016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.097501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1257/2521] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:45 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:46.101406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.111807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e109-cbce-41f7-b62b-9cf7bc8b2fb4 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.116271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.116889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.117162 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.117467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.118105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.119682 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.130691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1265/2522] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:46.134575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.145630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7f64ce-29de-452a-9944-a9f52640477e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.150422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f221e-33fc-4d59-bd28-1a92762c6d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.151028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f221e-33fc-4d59-bd28-1a92762c6d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.151307 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f221e-33fc-4d59-bd28-1a92762c6d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.151634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f221e-33fc-4d59-bd28-1a92762c6d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.152280 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f221e-33fc-4d59-bd28-1a92762c6d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.153971 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f221e-33fc-4d59-bd28-1a92762c6d5e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.165327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1258/2523] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:46.169780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.179765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750fdbd-3816-4379-881e-065e3f902bca admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.184819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.186054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.186345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.186611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] PATH_INFO: `/v3/projects/dfa67ccf22f94565bb4fc2743f64e973/users/5a137ad4c1374c2781c3c30084e8194d/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.201509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa67ccf22f94565bb4fc2743f64e973, user_id=5a137ad4c1374c2781c3c30084e8194d, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.204135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.217576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1266/2524] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:46 2022] PUT /identity/v3/projects/dfa67ccf22f94565bb4fc2743f64e973/users/5a137ad4c1374c2781c3c30084e8194d/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:46.229691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.229985 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.230262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.260884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] MFA Rules not processed for user `5a137ad4c1374c2781c3c30084e8194d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:46.273874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:46.341086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1259/2525] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:46 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:46.346241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.442395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd595f-3868-4147-8ce7-1f93858c3eac admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.448434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.449109 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.449419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.449700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.450339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.452493 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.470939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:46.490599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1267/2526] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:46 2022] POST /identity/v3/projects => generated 409 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:46.494975 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.508026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ecd5-6f37-4cbb-8ec7-d4fb647f14a2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.563899 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:46.592818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.593469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.593750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.594101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.600264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.602254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.621846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.623608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:46.629325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1260/2527] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:46 2022] POST /identity/v3/users => generated 311 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:46:46.630343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.643042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7da513-5521-4b88-ade4-913bb5951702 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.649271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.650012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.650338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.650672 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.651396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.653131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.665382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1261/2528] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:46:46.670156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.681884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d18393-a2e0-4a4c-b120-34ff7c60febd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.686917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.687599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.687879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.688148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] PATH_INFO: `/v3/projects/60166d190c234a93a733c0cb120a200b/users/ac998e9879974b30ba0023ba88023d22/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.696970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472113e-6619-4c2b-852e-a70447cf457e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.700647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.701239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.701544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.701819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.702939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60166d190c234a93a733c0cb120a200b, user_id=ac998e9879974b30ba0023ba88023d22, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.703562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:46.705607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.713895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.715362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.722710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1262/2529] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:46 2022] PUT /identity/v3/projects/60166d190c234a93a733c0cb120a200b/users/ac998e9879974b30ba0023ba88023d22/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:46:46.724568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1268/2530] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:46.726647 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.789472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf3c30-5f09-4e74-965e-c65456274d10 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.794167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4faf38-50cb-437a-a96f-b55e08e38da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.795353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4faf38-50cb-437a-a96f-b55e08e38da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.795627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4faf38-50cb-437a-a96f-b55e08e38da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.795895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4faf38-50cb-437a-a96f-b55e08e38da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.796534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4faf38-50cb-437a-a96f-b55e08e38da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.798162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4faf38-50cb-437a-a96f-b55e08e38da6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.807928 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1263/2531] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:46.812445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.823902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d335bf-804b-4187-950b-353ae1f62c7a service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:46.828487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:46.829124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.829436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.829714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] PATH_INFO: `/v3/projects/60166d190c234a93a733c0cb120a200b/users/ac998e9879974b30ba0023ba88023d22/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.831576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=60166d190c234a93a733c0cb120a200b, user_id=ac998e9879974b30ba0023ba88023d22, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:46.834555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:46.845167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1269/2532] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:46 2022] PUT /identity/v3/projects/60166d190c234a93a733c0cb120a200b/users/ac998e9879974b30ba0023ba88023d22/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:46:46.855222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:46.855509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:46.855782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:46.884447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] MFA Rules not processed for user `ac998e9879974b30ba0023ba88023d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:46.885619 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:46.959208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1264/2533] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:46 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:46.971219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:46.973017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:47.045225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f899d5-a26f-4329-b508-13d7648bf0df admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:47.049183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635d72e-4ce3-4b10-b7b7-0c450e63b7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:47.049873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d72e-4ce3-4b10-b7b7-0c450e63b7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:47.050228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d72e-4ce3-4b10-b7b7-0c450e63b7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:47.050502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635d72e-4ce3-4b10-b7b7-0c450e63b7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:47.060042 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d72e-4ce3-4b10-b7b7-0c450e63b7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:47.061507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635d72e-4ce3-4b10-b7b7-0c450e63b7d7 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:47.071717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1270/2534] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:46 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:47.233617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:47.244247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac2d37-f861-45e6-a9ff-3399f9a92181 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:47.247835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:47.248435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:47.248711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:47.248983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:47.261621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:47.310997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:47.312455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:47.322281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1265/2535] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:47 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:49.889584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:49.890030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:49.890030 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:49.910877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:49.912088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:49.971381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1271/2536] 10.222.0.67 () {58 vars in 967 bytes} [Mon Aug 29 23:46:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:46:49.984417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:49.985906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:50.067269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e80dcb-931c-42a7-b5fa-c63f3f6756e7 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:50.072521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:50.073165 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:50.073591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:50.073901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:50.083541 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:50.085132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:50.094433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1266/2537] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:46:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:46:51.371604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:51.375098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:51.425823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:51.505273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b34a1e-beda-4572-a15a-a62deff1e21e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:51.512603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:51.514499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:51.515143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:51.515624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:51.518020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:51.534972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:51.537660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ade4db-0f78-4ca3-8dc2-cf1599f8a26b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:51.553380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1272/2538] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:52.726665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:52.789805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf9c16-a8b4-4b9f-8e5e-b691038fbe8f service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:52.794852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:52.795662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:52.795942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:52.796215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] PATH_INFO: `/v3/users/5a137ad4c1374c2781c3c30084e8194d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:52.797367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a137ad4c1374c2781c3c30084e8194d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:52.799304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:52.844064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:52.845669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a137ad4c1374c2781c3c30084e8194d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:52.853290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a137ad4c1374c2781c3c30084e8194d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:52.865686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a137ad4c1374c2781c3c30084e8194d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:52.866705 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a137ad4c1374c2781c3c30084e8194d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:52.867306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a137ad4c1374c2781c3c30084e8194d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:52.881075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1267/2539] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:52 2022] DELETE /identity/v3/users/5a137ad4c1374c2781c3c30084e8194d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:52.885615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:52.886083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:52.886178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:52.905892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:52.907120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:52.975236 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1273/2540] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:52.984876 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:52.986484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:53.045659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a5aae-c432-4366-b024-e9f4b539621f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:53.049497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:53.050193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:53.050533 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:53.050886 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:53.060435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:53.061912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:53.071797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1268/2541] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:53.383337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:53.384887 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:53.400014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bba15-ed13-40e8-8ae0-3a2c61dabccb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:53.404777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:53.405527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:53.405902 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:53.406256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] PATH_INFO: `/v3/projects/dfa67ccf22f94565bb4fc2743f64e973` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:53.407462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa67ccf22f94565bb4fc2743f64e973)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:53.409666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:53.462251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa67ccf22f94565bb4fc2743f64e973', 'request_id': 'req-f6b4b39b-4443-4d9d-92eb-2d816743479e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.470520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa67ccf22f94565bb4fc2743f64e973', 'request_id': 'req-f6b4b39b-4443-4d9d-92eb-2d816743479e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.476550 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa67ccf22f94565bb4fc2743f64e973', 'request_id': 'req-f6b4b39b-4443-4d9d-92eb-2d816743479e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.488053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] The token cache is being invalidate because project dfa67ccf22f94565bb4fc2743f64e973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:53.488343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.488991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.490520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1274/2542] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:53 2022] DELETE /identity/v3/projects/dfa67ccf22f94565bb4fc2743f64e973 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:53.494900 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:53.505490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d5c77-ed9a-41bb-817d-977008a66498 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:53.571983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:53.572724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:53.573139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:53.573337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] PATH_INFO: `/v3/users/ac998e9879974b30ba0023ba88023d22` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:53.577295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac998e9879974b30ba0023ba88023d22)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:53.579874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:53.636212 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac998e9879974b30ba0023ba88023d22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.644547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac998e9879974b30ba0023ba88023d22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.653745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:53.659664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac998e9879974b30ba0023ba88023d22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.660443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac998e9879974b30ba0023ba88023d22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.661237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-304c792f-2a97-44ab-af5f-b1a51b4ca584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac998e9879974b30ba0023ba88023d22'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:53.677444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1269/2543] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:46:53 2022] DELETE /identity/v3/users/ac998e9879974b30ba0023ba88023d22 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:53.975766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:53.977240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:53.991278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4b39b-4443-4d9d-92eb-2d816743479e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.031175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:54.052480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.053160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.053459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.053730 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] PATH_INFO: `/v3/projects/60166d190c234a93a733c0cb120a200b` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.054856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60166d190c234a93a733c0cb120a200b)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.056755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.105056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60166d190c234a93a733c0cb120a200b', 'request_id': 'req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:54.112842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60166d190c234a93a733c0cb120a200b', 'request_id': 'req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:54.118469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60166d190c234a93a733c0cb120a200b', 'request_id': 'req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:54.129447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] The token cache is being invalidate because project 60166d190c234a93a733c0cb120a200b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:46:54.129737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:54.130372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-84cf50c1-7d2c-4878-8e31-08fa1cb809e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:46:54.131868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1275/2544] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:46:53 2022] DELETE /identity/v3/projects/60166d190c234a93a733c0cb120a200b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:54.136890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.137435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.137536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.158425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:54.159659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:54.218634 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1270/2545] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:54.226537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.226824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.227101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.248025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:54.249215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:54.258831 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1276/2546] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:54.263852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.273942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc322cb-d8cd-4bb3-92b9-f600da4f6605 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.278730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.279417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.279605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.279879 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.280557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:46:54.280933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.283363 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.296082 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1271/2547] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:46:54.300671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.315226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696594bd-a2ea-4dde-8f7f-d82585ed83e2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.319940 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.320545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.320822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.321085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.321748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.323852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.361420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1277/2548] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:54.366021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.376557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad428c-4540-4b0d-b51e-a313e5eb78b5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.431032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.431635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.431912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.432180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.432811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.435240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.457714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1272/2549] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:54.462028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.472390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd403c-6c2f-4c83-a39a-6de81d08ab51 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.477075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.477696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.477974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.478241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.478881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.480449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.490991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1278/2550] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:54.496285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.506810 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa694945-ecb0-4965-9af2-8c80d95ca276 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.511328 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155548-4fdc-4b58-bbb0-7e79f345018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.511917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155548-4fdc-4b58-bbb0-7e79f345018c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.512193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155548-4fdc-4b58-bbb0-7e79f345018c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.512459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155548-4fdc-4b58-bbb0-7e79f345018c admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.513091 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155548-4fdc-4b58-bbb0-7e79f345018c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.514712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155548-4fdc-4b58-bbb0-7e79f345018c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.525097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1273/2551] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:54.529729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.539820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f923d5-2055-45d8-9b64-4e8491107e50 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.545387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.546074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.546354 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.546626 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] PATH_INFO: `/v3/projects/9808ac8a4ffc4ed4bba5b1cfaefe895c/users/4d1e92a6df2e41919f814a7a13943802/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.564078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9808ac8a4ffc4ed4bba5b1cfaefe895c, user_id=4d1e92a6df2e41919f814a7a13943802, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.565852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.578995 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1279/2552] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:54 2022] PUT /identity/v3/projects/9808ac8a4ffc4ed4bba5b1cfaefe895c/users/4d1e92a6df2e41919f814a7a13943802/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:54.589635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.589925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.590201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.618769 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] MFA Rules not processed for user `4d1e92a6df2e41919f814a7a13943802`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:54.619913 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:54.661650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:54.694793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1274/2553] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:54.698872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.762409 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b1fe9-3065-406b-bf8e-12c62eec623f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.767387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.767788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.768069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.768344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.768993 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.770927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.783068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:54.806520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1280/2554] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:54.807687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.821279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605c22c-2b1e-4f2c-b0e0-0ea558ac036b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.881220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.881774 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.882055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.882327 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.882960 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.884874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.907173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1275/2555] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:54 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:54.911367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.922895 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d363dc-2cde-4a1a-a0af-6ddd8b88257a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.927868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.928476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.928754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.929052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.929732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.931337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.943080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1281/2556] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:54.946965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.959537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e47bc3-382e-49bd-af72-05d517eed677 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.964058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1bd17-8f72-4859-8b4e-293cd632e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:54.964690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bd17-8f72-4859-8b4e-293cd632e4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:54.964940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bd17-8f72-4859-8b4e-293cd632e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:54.965208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1bd17-8f72-4859-8b4e-293cd632e4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:54.966389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1bd17-8f72-4859-8b4e-293cd632e4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:54.967984 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1bd17-8f72-4859-8b4e-293cd632e4d6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:54.978211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1276/2557] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:54.983241 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:54.994022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44262b88-c54e-48e9-b7b2-6364495f3417 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:54.999988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.000643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.000928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.001297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] PATH_INFO: `/v3/projects/7360fc2b00f94c4faca23a35233dc3dc/users/188a36edabcd46dba2e75e5d8119f3dd/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.016011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7360fc2b00f94c4faca23a35233dc3dc, user_id=188a36edabcd46dba2e75e5d8119f3dd, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.018749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.034271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1282/2558] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:54 2022] PUT /identity/v3/projects/7360fc2b00f94c4faca23a35233dc3dc/users/188a36edabcd46dba2e75e5d8119f3dd/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:46:55.045388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.045683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.045955 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.073193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] MFA Rules not processed for user `188a36edabcd46dba2e75e5d8119f3dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:55.074431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:55.139404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1277/2559] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:55.144074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.209707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ffbd-2a2b-4c85-8732-480b10e0a3da admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.214433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.215035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.215313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.215583 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.216890 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.218830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.245499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1283/2560] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:46:55 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:55.249821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.260475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23a94c-27b6-4bf3-affd-bf4bf2301bfe None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.306627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:55.319896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.320502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.320786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.321083 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.321732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.323660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.346117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1278/2561] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:46:55 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:46:55.350166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.360720 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cd11-dc4c-4fff-9c0e-4cd6cfea0be2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.365649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.366251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.366529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.366793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.367427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.369026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.380393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1284/2562] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:46:55.384840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.395625 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4544c3-98af-46f7-b07d-a115fa19461e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.400471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.401123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.401432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.401712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] PATH_INFO: `/v3/projects/177cf10fe0744d50960df09396121caf/users/06b7093426244d08a76093bd8855ca01/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.417859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=177cf10fe0744d50960df09396121caf, user_id=06b7093426244d08a76093bd8855ca01, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.420294 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.433964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1279/2563] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:55 2022] PUT /identity/v3/projects/177cf10fe0744d50960df09396121caf/users/06b7093426244d08a76093bd8855ca01/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:55.438055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.448139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0d453-4c6e-4144-a151-601fd68306ca admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.505015 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ae970-7ac4-4dfb-af71-27dc888ac2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.505660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ae970-7ac4-4dfb-af71-27dc888ac2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.505938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ae970-7ac4-4dfb-af71-27dc888ac2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.506238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ae970-7ac4-4dfb-af71-27dc888ac2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.506869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ae970-7ac4-4dfb-af71-27dc888ac2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.508467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ae970-7ac4-4dfb-af71-27dc888ac2fb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.518680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1285/2564] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:46:55.522953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.534896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878b9df-fbca-4c88-93e3-fa535164cf5a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.539593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.540246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.540527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.540801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] PATH_INFO: `/v3/projects/177cf10fe0744d50960df09396121caf/users/06b7093426244d08a76093bd8855ca01/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.542777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=177cf10fe0744d50960df09396121caf, user_id=06b7093426244d08a76093bd8855ca01, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.545510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.557433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1280/2565] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:46:55 2022] PUT /identity/v3/projects/177cf10fe0744d50960df09396121caf/users/06b7093426244d08a76093bd8855ca01/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:46:55.625656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.625945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.626224 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.655874 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] MFA Rules not processed for user `06b7093426244d08a76093bd8855ca01`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:46:55.657009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:55.669839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:55.728956 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1286/2566] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:46:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:46:55.740283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:55.742032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:55.800944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0090a1a-bca7-442b-bc68-d34791cb2a3b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:55.804531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:55.805123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:55.805426 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:55.805692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:55.864039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:55.865505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:55.876261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1281/2567] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:57.179549 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:57.180988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:57.241539 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06a1c6-6f01-4f17-a9c3-80dcc995307e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:57.245146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:57.245891 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:57.246179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:57.246454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:57.248755 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:46:57.321498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:57.322959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:57.333988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1287/2568] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:57.403137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:57.411989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e3868-5330-49dc-b501-ca9a649e349c service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:57.415566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:57.416159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:57.416432 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:57.416721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:57.475554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:46:57.480026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:57.482036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:57.494300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1282/2569] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:46:58.040629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:46:58.051107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e661a3b-b5b6-4e5b-a14e-97e0b30df0b1 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:46:58.055115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:46:58.055745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:46:58.056022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:46:58.056271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:46:58.065832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:46:58.067251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:46:58.077073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1288/2570] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:46:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:00.670692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:00.672496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:00.691437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677af166-4d1a-498f-8abf-cd661abb6f14 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:00.696860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:00.697570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:00.697858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:00.698156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] PATH_INFO: `/v3/users/d90000dd2b094facafada1ada1c8573f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:00.703412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90000dd2b094facafada1ada1c8573f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:00.705496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:00.775192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90000dd2b094facafada1ada1c8573f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:00.776030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90000dd2b094facafada1ada1c8573f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:00.789137 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90000dd2b094facafada1ada1c8573f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:00.789988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90000dd2b094facafada1ada1c8573f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:00.790671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ae0c84e2-d4ba-4b3e-8eb5-d309609ec620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90000dd2b094facafada1ada1c8573f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:00.803983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1283/2571] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:00 2022] DELETE /identity/v3/users/d90000dd2b094facafada1ada1c8573f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:01.001763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.013001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca9901-ea2a-4aa4-9d3c-30fd54d4a063 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.065687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:01.079046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.079678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.079967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.080242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] PATH_INFO: `/v3/projects/abae41ba16dc487a83c19cc4cc5f95d3` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.081372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abae41ba16dc487a83c19cc4cc5f95d3)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.083570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.133248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abae41ba16dc487a83c19cc4cc5f95d3', 'request_id': 'req-2e2de12b-2c22-4e90-9058-2a0cef6caf32'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:01.139865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abae41ba16dc487a83c19cc4cc5f95d3', 'request_id': 'req-2e2de12b-2c22-4e90-9058-2a0cef6caf32'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:01.148965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abae41ba16dc487a83c19cc4cc5f95d3', 'request_id': 'req-2e2de12b-2c22-4e90-9058-2a0cef6caf32'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:01.161577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] The token cache is being invalidate because project abae41ba16dc487a83c19cc4cc5f95d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:01.161867 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:01.162555 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2e2de12b-2c22-4e90-9058-2a0cef6caf32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:01.167377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1289/2572] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:01 2022] DELETE /identity/v3/projects/abae41ba16dc487a83c19cc4cc5f95d3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:01.169812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.169994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.170269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.190500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:01.191721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:01.251057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1284/2573] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:47:01.259272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.259560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.259829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.280366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:01.281628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:01.290261 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1290/2574] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:01.294412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.304778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21caadd-fd3a-431e-85b7-86c2586630ed None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.309681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.310364 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.310713 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.311063 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.311902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:01.312274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.314018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.326903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1285/2575] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:47:01.331443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.341963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59bf29-1716-4f0f-8f40-3afdd97f6603 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.346958 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.347580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.347870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.348147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.348829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.350855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.378442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1291/2576] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:01 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:01.382980 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.394076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b2cfd3-b8b6-4916-bcea-d87c0168d40a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.443868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:01.455397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.456009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.456285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.456554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.457489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.459486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.480449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1286/2577] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:01 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:47:01.484632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.495072 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf9168-abf3-479a-be57-1456d2f66145 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.499746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.500340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.500619 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.500890 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.501567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.503192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.513724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1292/2578] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:01.517613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.527918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515e692-1689-410c-9dcc-77655767e6d8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.533209 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3c46-3aac-4525-8c7b-a6af4675aced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.533839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3c46-3aac-4525-8c7b-a6af4675aced admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.534121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3c46-3aac-4525-8c7b-a6af4675aced admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.534392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3c46-3aac-4525-8c7b-a6af4675aced admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.535146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3c46-3aac-4525-8c7b-a6af4675aced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.536762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3c46-3aac-4525-8c7b-a6af4675aced admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.547624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1287/2579] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:01.552597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.563001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918337cf-6a3f-4ea2-9cfb-807c736908b2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.568436 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.569079 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.569377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.569667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] PATH_INFO: `/v3/projects/fb87330acaa848c998cc20b73cb94525/users/b38b4c21fb5f494ab90cef7e79ca8030/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.585187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb87330acaa848c998cc20b73cb94525, user_id=b38b4c21fb5f494ab90cef7e79ca8030, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.587884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.603154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1293/2580] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:01 2022] PUT /identity/v3/projects/fb87330acaa848c998cc20b73cb94525/users/b38b4c21fb5f494ab90cef7e79ca8030/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:01.614750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.615034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.615313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.644962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] MFA Rules not processed for user `b38b4c21fb5f494ab90cef7e79ca8030`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:01.646214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:01.712038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1288/2581] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:01.723592 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:01.725305 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:01.798218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ffabb-00c9-4fa0-b30c-4e335ac6ba55 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:01.803618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfdf3a1-e4b5-4b32-920d-01d4c38f2178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:01.804223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdf3a1-e4b5-4b32-920d-01d4c38f2178 service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:01.804509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdf3a1-e4b5-4b32-920d-01d4c38f2178 service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:01.804777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdf3a1-e4b5-4b32-920d-01d4c38f2178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:01.812863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdf3a1-e4b5-4b32-920d-01d4c38f2178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:01.814860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfdf3a1-e4b5-4b32-920d-01d4c38f2178 service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:01.819183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:01.824076 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1294/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:02.077608 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:02.079123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:02.173739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1575c3-90d1-4411-8a0d-a294713217f5 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:02.178268 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:02.178903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:02.179179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:02.179447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] PATH_INFO: `/v3/users/4d1e92a6df2e41919f814a7a13943802` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:02.180589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1e92a6df2e41919f814a7a13943802)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:02.182594 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:02.234404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1e92a6df2e41919f814a7a13943802'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.242846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1e92a6df2e41919f814a7a13943802'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.248731 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:02.257555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1e92a6df2e41919f814a7a13943802'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.258488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1e92a6df2e41919f814a7a13943802'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.259604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1e92a6df2e41919f814a7a13943802'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.272463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1289/2583] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:02 2022] DELETE /identity/v3/users/4d1e92a6df2e41919f814a7a13943802 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:02.277094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:02.277624 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:02.277854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:02.297167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:02.298401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:02.358189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1295/2584] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:02.368312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:02.369787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:02.436864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64aaac-64b8-4bee-836b-2acfae693639 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:02.441687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:02.442297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:02.442582 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:02.442942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:02.452894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:02.454579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:02.464595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1290/2585] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:02.731918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:02.733395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:02.746234 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea2a87-fb6f-49ec-a5c4-2e098c09253d None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:02.751119 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:02.751860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:02.752113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:02.752367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] PATH_INFO: `/v3/projects/9808ac8a4ffc4ed4bba5b1cfaefe895c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:02.753973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9808ac8a4ffc4ed4bba5b1cfaefe895c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:02.756696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:02.805653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9808ac8a4ffc4ed4bba5b1cfaefe895c', 'request_id': 'req-27d03022-d993-4c6b-80d0-fc2536fdacb9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.813293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9808ac8a4ffc4ed4bba5b1cfaefe895c', 'request_id': 'req-27d03022-d993-4c6b-80d0-fc2536fdacb9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.819703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9808ac8a4ffc4ed4bba5b1cfaefe895c', 'request_id': 'req-27d03022-d993-4c6b-80d0-fc2536fdacb9'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.831688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] The token cache is being invalidate because project 9808ac8a4ffc4ed4bba5b1cfaefe895c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:02.831971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.832963 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.834494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1296/2586] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:02 2022] DELETE /identity/v3/projects/9808ac8a4ffc4ed4bba5b1cfaefe895c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:02.838455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:02.848820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53546e-ecf5-4ecd-99c3-01804702c503 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:02.916039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:02.916574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:02.916860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:02.917122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] PATH_INFO: `/v3/users/188a36edabcd46dba2e75e5d8119f3dd` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:02.918304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188a36edabcd46dba2e75e5d8119f3dd)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:02.920283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:02.966834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188a36edabcd46dba2e75e5d8119f3dd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.973751 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188a36edabcd46dba2e75e5d8119f3dd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.985386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188a36edabcd46dba2e75e5d8119f3dd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.986041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188a36edabcd46dba2e75e5d8119f3dd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.986636 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188a36edabcd46dba2e75e5d8119f3dd'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:02.999346 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1291/2587] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:02 2022] DELETE /identity/v3/users/188a36edabcd46dba2e75e5d8119f3dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:03.273648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:03.275152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:03.293967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d03022-d993-4c6b-80d0-fc2536fdacb9 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:03.354687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:03.355322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:03.355595 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:03.355862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] PATH_INFO: `/v3/projects/7360fc2b00f94c4faca23a35233dc3dc` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:03.357221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7360fc2b00f94c4faca23a35233dc3dc)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:03.359288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:03.393904 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:03.411629 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7360fc2b00f94c4faca23a35233dc3dc', 'request_id': 'req-fd854254-6f86-436b-a8b7-ae370a6242f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.421017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7360fc2b00f94c4faca23a35233dc3dc', 'request_id': 'req-fd854254-6f86-436b-a8b7-ae370a6242f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.429031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7360fc2b00f94c4faca23a35233dc3dc', 'request_id': 'req-fd854254-6f86-436b-a8b7-ae370a6242f0'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.444703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] The token cache is being invalidate because project 7360fc2b00f94c4faca23a35233dc3dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:03.445112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.446084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.448228 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1297/2588] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:03 2022] DELETE /identity/v3/projects/7360fc2b00f94c4faca23a35233dc3dc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:03.454404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:03.455951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:03.465000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:03.472055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4d9a1-f72f-48a3-a6c1-0f7c9a3fae98 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:03.538391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:03.539092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:03.539437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:03.539721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] PATH_INFO: `/v3/users/06b7093426244d08a76093bd8855ca01` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:03.540826 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b7093426244d08a76093bd8855ca01)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:03.542771 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:03.590576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b7093426244d08a76093bd8855ca01'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.598006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b7093426244d08a76093bd8855ca01'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.611182 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b7093426244d08a76093bd8855ca01'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.611873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b7093426244d08a76093bd8855ca01'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.612495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2676be91-c3b6-456d-b590-661931f6502c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b7093426244d08a76093bd8855ca01'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:03.625742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1292/2589] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:03 2022] DELETE /identity/v3/users/06b7093426244d08a76093bd8855ca01 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:03.911799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:03.913380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:03.929068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd854254-6f86-436b-a8b7-ae370a6242f0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:03.988315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:03.988869 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:03.989172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:03.989477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] PATH_INFO: `/v3/projects/177cf10fe0744d50960df09396121caf` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:03.990610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] RBAC: Authorizing `identity:delete_project(project_id=177cf10fe0744d50960df09396121caf)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:03.992618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.038849 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177cf10fe0744d50960df09396121caf', 'request_id': 'req-894f04f8-7120-4bb8-b2bb-1758aaacd94f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.047075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177cf10fe0744d50960df09396121caf', 'request_id': 'req-894f04f8-7120-4bb8-b2bb-1758aaacd94f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.052670 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177cf10fe0744d50960df09396121caf', 'request_id': 'req-894f04f8-7120-4bb8-b2bb-1758aaacd94f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.071479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] The token cache is being invalidate because project 177cf10fe0744d50960df09396121caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:04.071772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.072425 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-894f04f8-7120-4bb8-b2bb-1758aaacd94f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.074689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1298/2590] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:03 2022] DELETE /identity/v3/projects/177cf10fe0744d50960df09396121caf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:04.081620 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.082408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.082529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.103529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:04.104809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.164952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1293/2591] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:04.173211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba85d29-a590-463b-8446-92469e186615 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.173536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba85d29-a590-463b-8446-92469e186615 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.173817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba85d29-a590-463b-8446-92469e186615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.193847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1ba85d29-a590-463b-8446-92469e186615 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:04.195081 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1ba85d29-a590-463b-8446-92469e186615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.203584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1299/2592] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:04.208211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.219111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eac01-b939-4a5a-a05f-7b2ad8dbf36e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.223670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.224270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.224549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.224846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.225529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:04.225834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.227429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.239370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1294/2593] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:47:04.243506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba85d29-a590-463b-8446-92469e186615 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.252746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba85d29-a590-463b-8446-92469e186615 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.257311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.258559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.258559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.258559 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.259095 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.261001 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.289824 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1300/2594] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:04 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:04.293917 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.303874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aba336-910a-4584-bdab-046248bb13c5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.308554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:04.362387 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.362991 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.363299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.363573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.364232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.366193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.388136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1295/2595] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:04 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:04.392282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.402465 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d5da3e-c181-4af8-9fae-28ad20d7b488 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.407687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.408288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.408565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.408840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.409523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.411144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.421138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1301/2596] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:04.425014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.435003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500778c4-662b-42f2-aca2-e5fe1517454a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.439561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad091971-c5a4-489d-b1d4-d50987ede3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.440152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad091971-c5a4-489d-b1d4-d50987ede3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.440542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad091971-c5a4-489d-b1d4-d50987ede3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.440734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad091971-c5a4-489d-b1d4-d50987ede3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.441324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad091971-c5a4-489d-b1d4-d50987ede3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.443729 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad091971-c5a4-489d-b1d4-d50987ede3d9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.455094 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1296/2597] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:04.459811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.466743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:04.470750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2dc65-b375-4db3-b6fc-3f6795fab01e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.477441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.478280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.478728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.479002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] PATH_INFO: `/v3/projects/ddfcc1b28de34239881bacda21458f79/users/fca79c6c0ee84b8cbc98e4d4a6ea0994/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.494692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddfcc1b28de34239881bacda21458f79, user_id=fca79c6c0ee84b8cbc98e4d4a6ea0994, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.497566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.510690 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1302/2598] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:04 2022] PUT /identity/v3/projects/ddfcc1b28de34239881bacda21458f79/users/fca79c6c0ee84b8cbc98e4d4a6ea0994/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:04.522264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a258e-698f-45e8-8165-201494290636 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.522555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a258e-698f-45e8-8165-201494290636 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.522832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a258e-698f-45e8-8165-201494290636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.556115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-e63a258e-698f-45e8-8165-201494290636 None None] MFA Rules not processed for user `fca79c6c0ee84b8cbc98e4d4a6ea0994`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:04.556115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e63a258e-698f-45e8-8165-201494290636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.559129 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.561056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.626304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1297/2599] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:04.630971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdebcc7-06d7-437f-a41b-e43f18919874 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.636181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.636801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a258e-698f-45e8-8165-201494290636 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.636924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.637112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.637953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] PATH_INFO: `/v3/users/b38b4c21fb5f494ab90cef7e79ca8030` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.638745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-e63a258e-698f-45e8-8165-201494290636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.639100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38b4c21fb5f494ab90cef7e79ca8030)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.641011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.688704 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38b4c21fb5f494ab90cef7e79ca8030'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.696491 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a258e-698f-45e8-8165-201494290636 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.697148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38b4c21fb5f494ab90cef7e79ca8030'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.700805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a022a-cb65-4b0c-8c26-362eda2e0138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.701475 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a022a-cb65-4b0c-8c26-362eda2e0138 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.701757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a022a-cb65-4b0c-8c26-362eda2e0138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.702051 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a022a-cb65-4b0c-8c26-362eda2e0138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.705683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38b4c21fb5f494ab90cef7e79ca8030'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.706338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38b4c21fb5f494ab90cef7e79ca8030'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.711482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a022a-cb65-4b0c-8c26-362eda2e0138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.712941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a022a-cb65-4b0c-8c26-362eda2e0138 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.719134 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38b4c21fb5f494ab90cef7e79ca8030'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:04.721970 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1298/2600] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:47:04.725186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1303/2601] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:04 2022] DELETE /identity/v3/users/b38b4c21fb5f494ab90cef7e79ca8030 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:04.729615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488683ce-b24c-4706-b528-3377f49d794b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.729910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488683ce-b24c-4706-b528-3377f49d794b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.730188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488683ce-b24c-4706-b528-3377f49d794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.754171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-488683ce-b24c-4706-b528-3377f49d794b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:04.755386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-488683ce-b24c-4706-b528-3377f49d794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.774304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:04.824318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1299/2602] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:04.834782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:04.836247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:04.899829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad790-667f-49f3-85e0-e1b81fb3e883 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:04.903686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183dacb-6737-4e8c-a01a-3910ddcc3a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:04.904361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183dacb-6737-4e8c-a01a-3910ddcc3a4a service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:04.904680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183dacb-6737-4e8c-a01a-3910ddcc3a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:04.905004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183dacb-6737-4e8c-a01a-3910ddcc3a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:04.914773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183dacb-6737-4e8c-a01a-3910ddcc3a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:04.916327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183dacb-6737-4e8c-a01a-3910ddcc3a4a service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:04.926441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1304/2603] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:05.238803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488683ce-b24c-4706-b528-3377f49d794b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.240295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-488683ce-b24c-4706-b528-3377f49d794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:05.255262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488683ce-b24c-4706-b528-3377f49d794b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.262485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.263135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.263336 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.263617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] PATH_INFO: `/v3/projects/fb87330acaa848c998cc20b73cb94525` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.264763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb87330acaa848c998cc20b73cb94525)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.266976 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.316177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb87330acaa848c998cc20b73cb94525', 'request_id': 'req-2256e5c5-1c86-4993-981a-a201f4939096'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:05.323887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb87330acaa848c998cc20b73cb94525', 'request_id': 'req-2256e5c5-1c86-4993-981a-a201f4939096'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:05.329738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb87330acaa848c998cc20b73cb94525', 'request_id': 'req-2256e5c5-1c86-4993-981a-a201f4939096'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:05.341471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] The token cache is being invalidate because project fb87330acaa848c998cc20b73cb94525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:05.341757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:05.342401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-2256e5c5-1c86-4993-981a-a201f4939096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:05.343884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1300/2604] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:05 2022] DELETE /identity/v3/projects/fb87330acaa848c998cc20b73cb94525 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:05.348786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.349070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.349390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.357847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:05.373884 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:05.375330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:05.435785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1305/2605] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:05.443684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.443964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.444236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.463870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:05.465093 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:05.473875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1301/2606] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:05.478111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.488275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca00c5-755e-49d2-9d81-caa59912b2d2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.492780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.493395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.493677 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.493947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.494590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:05.494890 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.496488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.508088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1306/2607] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:47:05.512443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.521688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b460bb-b6cd-4637-95c6-7668dd234e7d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.526322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.526910 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.527181 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.527448 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.528553 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.530484 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.557840 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1302/2608] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:05 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:47:05.562254 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.572284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52df1fa-d1bb-425e-b768-547429de92af admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.630274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.630866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.631140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.631412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.632039 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.633998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.655317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1307/2609] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:05 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:05.659783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.673320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc2d31-79ca-4f5b-abb8-5fbfbf28414f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.678174 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.678809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.679112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.679390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.680083 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.681865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.692006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1303/2610] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:05.695983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.706632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665be59-d866-4c8d-a139-7a01701fe5e5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.711500 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c1aa21-58a9-4b0d-b0f3-1b67952dd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.712094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1aa21-58a9-4b0d-b0f3-1b67952dd285 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.712375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1aa21-58a9-4b0d-b0f3-1b67952dd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.712650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1aa21-58a9-4b0d-b0f3-1b67952dd285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.713283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1aa21-58a9-4b0d-b0f3-1b67952dd285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.714920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c1aa21-58a9-4b0d-b0f3-1b67952dd285 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.726218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1308/2611] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:05.730219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.740521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880691fe-9e6b-4b2e-9368-2cbed74ecced admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.745254 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.745936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.746219 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.746495 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] PATH_INFO: `/v3/projects/2f6d708c0f5f47108108af5e2819dbc4/users/a9ea2abca5eb4cc78eaae732e03ac65c/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.761256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6d708c0f5f47108108af5e2819dbc4, user_id=a9ea2abca5eb4cc78eaae732e03ac65c, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.764416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:05.777741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1304/2612] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:05 2022] PUT /identity/v3/projects/2f6d708c0f5f47108108af5e2819dbc4/users/a9ea2abca5eb4cc78eaae732e03ac65c/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:05.788752 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.789069 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.789361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.818739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] MFA Rules not processed for user `a9ea2abca5eb4cc78eaae732e03ac65c`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:05.820698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:05.889445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:05.899833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1309/2613] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:05.901013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:05.943716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:05.964779 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dded0-9f76-4129-9d96-0883f98d36d7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:05.970227 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88413c12-b313-4400-b85a-920de19e43e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:05.970838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413c12-b313-4400-b85a-920de19e43e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:05.971118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413c12-b313-4400-b85a-920de19e43e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:05.971393 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88413c12-b313-4400-b85a-920de19e43e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:05.972025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88413c12-b313-4400-b85a-920de19e43e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:05.974030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88413c12-b313-4400-b85a-920de19e43e8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.000761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1305/2614] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:06.005011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.016923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902d14f-2a56-4f1d-9583-458148f83a67 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.076145 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.076765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.077045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.077420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.077997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.089473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.102356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.102655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.102935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.103558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1310/2615] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:06 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:06.107418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.118469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6edf64-5709-49fb-a82b-de3fb070710e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.122733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] MFA Rules not processed for user `fca79c6c0ee84b8cbc98e4d4a6ea0994`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:06.123825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.123994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:06.124421 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.124700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.124973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.125649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.127244 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.138367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1311/2616] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:47:06.142785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.153554 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908b833-e3cf-419a-8e84-0d025cc00942 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.158127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.159146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.159431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.159850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] PATH_INFO: `/v3/projects/d500bc4b6e1c415fbe72d3907a3aefc6/users/99102c989f184bce8fa584743ae5ee6e/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.175154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d500bc4b6e1c415fbe72d3907a3aefc6, user_id=99102c989f184bce8fa584743ae5ee6e, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.178152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.182722 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1306/2617] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:47:06.192113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1312/2618] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:06 2022] PUT /identity/v3/projects/d500bc4b6e1c415fbe72d3907a3aefc6/users/99102c989f184bce8fa584743ae5ee6e/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:06.196237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.209208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90eab6-4908-484f-8aaf-c80795b0d07f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.267943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcee67-c21a-4ffa-b43e-575d0e0131ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.268570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcee67-c21a-4ffa-b43e-575d0e0131ec admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.268736 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcee67-c21a-4ffa-b43e-575d0e0131ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.269006 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcee67-c21a-4ffa-b43e-575d0e0131ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.269691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcee67-c21a-4ffa-b43e-575d0e0131ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.271292 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcee67-c21a-4ffa-b43e-575d0e0131ec admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.281968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1307/2619] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:06.286596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.296699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee6fcf-aae0-4ff4-8526-9c71eeabfcc7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.301518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.302459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.302816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.303191 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] PATH_INFO: `/v3/projects/d500bc4b6e1c415fbe72d3907a3aefc6/users/99102c989f184bce8fa584743ae5ee6e/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.305121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d500bc4b6e1c415fbe72d3907a3aefc6, user_id=99102c989f184bce8fa584743ae5ee6e, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.307779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.320332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1313/2620] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:06 2022] PUT /identity/v3/projects/d500bc4b6e1c415fbe72d3907a3aefc6/users/99102c989f184bce8fa584743ae5ee6e/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:06.333011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b92c-2cdc-4607-9c7d-8361001a78bb None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.333419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b92c-2cdc-4607-9c7d-8361001a78bb None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.333732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062b92c-2cdc-4607-9c7d-8361001a78bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.362488 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b062b92c-2cdc-4607-9c7d-8361001a78bb None None] MFA Rules not processed for user `99102c989f184bce8fa584743ae5ee6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:06.363726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b062b92c-2cdc-4607-9c7d-8361001a78bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:06.418653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:06.437745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1308/2621] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:06.448689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.451272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:06.513392 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06455d96-54f1-4147-b076-3a419490c333 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.517077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024478a-bba4-4f2e-b07b-50d6db527853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.517763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024478a-bba4-4f2e-b07b-50d6db527853 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.518096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024478a-bba4-4f2e-b07b-50d6db527853 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.518310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024478a-bba4-4f2e-b07b-50d6db527853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.576088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:06.580773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024478a-bba4-4f2e-b07b-50d6db527853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.582471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024478a-bba4-4f2e-b07b-50d6db527853 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.593488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1314/2622] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:06.670786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9219b-5461-4cfb-9aff-b9fc5a83b37e None None] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.671648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9219b-5461-4cfb-9aff-b9fc5a83b37e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.672185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9219b-5461-4cfb-9aff-b9fc5a83b37e None None] PATH_INFO: `/` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.673753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1309/2623] 10.222.0.67 () {54 vars in 961 bytes} [Mon Aug 29 23:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 29 23:47:06.683198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.683485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.683747 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.706527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] MFA Rules not processed for user `6548e5f5d9e24b4eadde36b3b8a37882`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:06.708226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:06.781002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1315/2624] 10.222.0.67 () {58 vars in 1058 bytes} [Mon Aug 29 23:47:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:06.788451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9219b-5461-4cfb-9aff-b9fc5a83b37e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:06.804646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9219b-5461-4cfb-9aff-b9fc5a83b37e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:06.810403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:06.811007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:06.811283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:06.811549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:06.813380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:06.826469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:06.828110 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:06.841696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1310/2625] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:09.218842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:09.228860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfee910-ee0c-4a2c-a8b2-27fb5cd1c8f0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:09.233158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ef7b7-50fc-4a05-a61a-9d45357e8d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:09.233900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef7b7-50fc-4a05-a61a-9d45357e8d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:09.234175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef7b7-50fc-4a05-a61a-9d45357e8d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:09.234445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ef7b7-50fc-4a05-a61a-9d45357e8d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:09.245664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef7b7-50fc-4a05-a61a-9d45357e8d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:09.247177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ef7b7-50fc-4a05-a61a-9d45357e8d4c service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:09.258489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1316/2626] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:14.500411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:14.502035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:14.604121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f743c0-83da-444e-a68a-455ea33fba9e service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:14.612753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:14.613436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:14.613817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:14.614127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:14.616756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:14.632179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:14.634416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:14.646293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1311/2627] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:19.253654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=38 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:21.155473 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4404f0-6e82-4473-9eb7-7b87ba0aa53b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:21.156019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4404f0-6e82-4473-9eb7-7b87ba0aa53b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:21.156019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4404f0-6e82-4473-9eb7-7b87ba0aa53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:21.176792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8c4404f0-6e82-4473-9eb7-7b87ba0aa53b None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:21.178022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8c4404f0-6e82-4473-9eb7-7b87ba0aa53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:21.234186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1317/2628] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:47:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:47:21.255476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:21.256872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:21.326224 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f11ac3-ae71-43ab-935f-670b833faf9b service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:21.331222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:21.331820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:21.332355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:21.332623 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:21.340830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:21.343003 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:21.351306 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1312/2629] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:47:21.872361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:21.872650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:21.872925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:21.893273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:21.894488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:21.901453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1318/2630] 10.222.0.67 () {58 vars in 967 bytes} [Mon Aug 29 23:47:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:47:21.913446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:21.924568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41d755f-7bb0-4ce1-b363-9c22024cf4c7 service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:21.929846 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cadf2-1851-45d6-8302-84ff24e3a8df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:21.930478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cadf2-1851-45d6-8302-84ff24e3a8df service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:21.930763 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cadf2-1851-45d6-8302-84ff24e3a8df service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:21.931039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cadf2-1851-45d6-8302-84ff24e3a8df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:21.944542 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cadf2-1851-45d6-8302-84ff24e3a8df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:21.946262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488cadf2-1851-45d6-8302-84ff24e3a8df service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:21.957822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1313/2631] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:47:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:47:21.958879 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:22.029056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f75206-7c3a-4f14-98cf-adf7291459c9 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:22.033951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:22.034587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.034999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.035281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] PATH_INFO: `/v3/users/a9ea2abca5eb4cc78eaae732e03ac65c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.036424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ea2abca5eb4cc78eaae732e03ac65c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:22.038381 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:22.090046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ea2abca5eb4cc78eaae732e03ac65c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.097175 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ea2abca5eb4cc78eaae732e03ac65c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.105911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ea2abca5eb4cc78eaae732e03ac65c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.106544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ea2abca5eb4cc78eaae732e03ac65c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.120247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-48364434-7516-4e11-b8af-b4a8b8d86f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ea2abca5eb4cc78eaae732e03ac65c'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.128064 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1319/2632] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:21 2022] DELETE /identity/v3/users/a9ea2abca5eb4cc78eaae732e03ac65c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:22.132555 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.132921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.133196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.154916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:22.156191 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.186788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.187274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.187385 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.193983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:22.206724 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:22.208232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.219933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1314/2633] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:22.220816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:22.230045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:22.231788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.269683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1320/2634] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:47:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:22.281943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:22.283442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.292188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160378b-844f-468a-b5ec-fcd82a50958e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:22.296422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:22.297025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.297309 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.297612 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.307300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:22.308747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:22.319297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1315/2635] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:47:22.362143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81e045-018c-4c33-b69f-ebbc080e3ea6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:22.368485 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:22.369623 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.370165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.370719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.381031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:22.382850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:22.393046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1321/2636] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:47:22.613341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:22.614825 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.630817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267c086c-6baa-47be-a839-ce3d65a49f3d service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:22.635871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:22.636402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.637609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.638252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] PATH_INFO: `/v3/projects/2f6d708c0f5f47108108af5e2819dbc4` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.640053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6d708c0f5f47108108af5e2819dbc4)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:22.641989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:22.692807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6d708c0f5f47108108af5e2819dbc4', 'request_id': 'req-7333df8e-33f0-4065-9b1d-8c9238a3df08'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.702045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6d708c0f5f47108108af5e2819dbc4', 'request_id': 'req-7333df8e-33f0-4065-9b1d-8c9238a3df08'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.708481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6d708c0f5f47108108af5e2819dbc4', 'request_id': 'req-7333df8e-33f0-4065-9b1d-8c9238a3df08'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.720034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] The token cache is being invalidate because project 2f6d708c0f5f47108108af5e2819dbc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:22.720318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.720974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7333df8e-33f0-4065-9b1d-8c9238a3df08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.722704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1316/2637] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:22 2022] DELETE /identity/v3/projects/2f6d708c0f5f47108108af5e2819dbc4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:22.726702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:22.737599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460eef0-cd52-4271-b809-3df0a311f059 service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:22.754369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.754734 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.755119 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.776157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:22.777396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.797964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:22.798591 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.798870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.799135 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] PATH_INFO: `/v3/users/99102c989f184bce8fa584743ae5ee6e` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:22.800367 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99102c989f184bce8fa584743ae5ee6e)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:22.802361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:22.838458 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1317/2638] 10.222.0.67 () {58 vars in 967 bytes} [Mon Aug 29 23:47:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:47:22.851844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:22.853276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:22.854018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99102c989f184bce8fa584743ae5ee6e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.859883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:22.862208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99102c989f184bce8fa584743ae5ee6e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.867908 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:22.871504 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99102c989f184bce8fa584743ae5ee6e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.872179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99102c989f184bce8fa584743ae5ee6e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.886917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99102c989f184bce8fa584743ae5ee6e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:22.893521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1322/2639] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:22 2022] DELETE /identity/v3/users/99102c989f184bce8fa584743ae5ee6e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:22.932500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fbc637-99cd-4e2b-a472-ab9bbb829a33 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:22.997214 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:22.997866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:22.998743 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:22.999028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.000875 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:23.064588 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.066391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82735ce9-2f70-4eee-b54b-5b2694ab427a service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.075463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1318/2640] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 29 23:47:23.167490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.168947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:23.255250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63840f2a-1398-403f-9fc2-4acfb6492506 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.259650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.260297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.260575 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.260845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] PATH_INFO: `/v3/projects/d500bc4b6e1c415fbe72d3907a3aefc6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.261992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d500bc4b6e1c415fbe72d3907a3aefc6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.264407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.315451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd500bc4b6e1c415fbe72d3907a3aefc6', 'request_id': 'req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:23.323570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd500bc4b6e1c415fbe72d3907a3aefc6', 'request_id': 'req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:23.330743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd500bc4b6e1c415fbe72d3907a3aefc6', 'request_id': 'req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:23.342835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] The token cache is being invalidate because project d500bc4b6e1c415fbe72d3907a3aefc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:23.343046 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:23.343853 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-e2d43853-09b8-4fc4-a16c-dce8094b8dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:23.347209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1323/2641] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:23 2022] DELETE /identity/v3/projects/d500bc4b6e1c415fbe72d3907a3aefc6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:23.351848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.352332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.352497 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.376158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:23.377422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:23.430351 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:23.441964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1319/2642] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:23.449785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.450177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.450545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.471702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:23.473010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:23.481243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1324/2643] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:23.486262 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.496304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191fa12-5eb8-478b-9679-a1ee4fb038cc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.501222 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.501943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.502375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.502661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.503359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:23.503720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.505469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.517808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1320/2644] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 29 23:47:23.522173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.531770 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db233c-45b6-49be-a5cf-4309893c792e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.536565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.537155 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.537489 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.537760 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.538387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.540274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.573443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1325/2645] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:23 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:47:23.574465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.585210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53886-7224-447e-8d34-4b4d7c43734d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.644901 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.645550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.645974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.646251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.646912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.648913 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.671106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1321/2646] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:23 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:23.675194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.685829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe44f9a-f5e0-456c-ba8e-e1c37282dc9a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.690610 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.691225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.691534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.691810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.692461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.694127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.707372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1326/2647] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:23.710148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.721145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee664160-f5a7-4e1b-9419-37f5f68e812b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.725827 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7efbb-be6d-41ba-a04a-ac8b40c8f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.726431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7efbb-be6d-41ba-a04a-ac8b40c8f459 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.726738 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7efbb-be6d-41ba-a04a-ac8b40c8f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.727139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7efbb-be6d-41ba-a04a-ac8b40c8f459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.727787 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7efbb-be6d-41ba-a04a-ac8b40c8f459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.729412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a7efbb-be6d-41ba-a04a-ac8b40c8f459 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.740489 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1322/2648] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:23.745165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.755631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a10794-c2e3-4dd2-9964-fcb5b41cf0b3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:23.760423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:23.761077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.761373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.761647 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] PATH_INFO: `/v3/projects/61fe605cc0d64fc2b3aed95cceb7a2fa/users/beaf7657188141f69ee224c9dd94b85d/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.778252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61fe605cc0d64fc2b3aed95cceb7a2fa, user_id=beaf7657188141f69ee224c9dd94b85d, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:23.781548 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:23.790491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:23.797222 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1327/2649] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:23 2022] PUT /identity/v3/projects/61fe605cc0d64fc2b3aed95cceb7a2fa/users/beaf7657188141f69ee224c9dd94b85d/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:23.807753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:23.808041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:23.808313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:23.837630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] MFA Rules not processed for user `beaf7657188141f69ee224c9dd94b85d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:23.838850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:23.918749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1323/2650] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:23.923287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:23.997407 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefab4e-eefa-41b8-9f72-6ea915293936 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.003012 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.003628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.004033 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.004177 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.004873 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.007074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.037472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1328/2651] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:23 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:24.041035 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:24.054377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f485c54-5d53-4966-886d-559e74babaf8 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.108962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:24.120288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.120931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.121211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.121520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.122147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.124103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.149192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1324/2652] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:24 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:24.155208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:24.164989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60ea8-3994-4ad6-a05d-31b076f45e19 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.171128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.171802 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.172083 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.172423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.173051 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.174732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.188810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1329/2653] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:24.193665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:24.205151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fe802-db2e-4974-b244-e222faf0a232 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.213406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.214359 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.214515 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.214657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] PATH_INFO: `/v3/projects/8a7148f98ba94e38be793f881e4f82fa/users/0431c3ae739d4c0586e0509772ee1ad8/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.230389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7148f98ba94e38be793f881e4f82fa, user_id=0431c3ae739d4c0586e0509772ee1ad8, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.233106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.246033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1325/2654] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:24 2022] PUT /identity/v3/projects/8a7148f98ba94e38be793f881e4f82fa/users/0431c3ae739d4c0586e0509772ee1ad8/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:24.250825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:24.260701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058037b-a6ce-4fb8-99cc-57a75f75927d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.327900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492d7dc-8710-4858-8387-4487fe3e1eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.328509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d7dc-8710-4858-8387-4487fe3e1eee admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.328834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d7dc-8710-4858-8387-4487fe3e1eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.329104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492d7dc-8710-4858-8387-4487fe3e1eee admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.329787 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492d7dc-8710-4858-8387-4487fe3e1eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.331397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492d7dc-8710-4858-8387-4487fe3e1eee admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.341663 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1330/2655] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:24.346159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:24.356467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7972e-e08e-445b-8cf9-83bfbdb3a330 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.361185 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.361857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.362136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.362403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] PATH_INFO: `/v3/projects/8a7148f98ba94e38be793f881e4f82fa/users/0431c3ae739d4c0586e0509772ee1ad8/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.364300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7148f98ba94e38be793f881e4f82fa, user_id=0431c3ae739d4c0586e0509772ee1ad8, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.367048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.378696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1326/2656] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:24 2022] PUT /identity/v3/projects/8a7148f98ba94e38be793f881e4f82fa/users/0431c3ae739d4c0586e0509772ee1ad8/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:24.392487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.392820 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.393104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.422434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] MFA Rules not processed for user `0431c3ae739d4c0586e0509772ee1ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:24.423734 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:24.481213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:24.493171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1331/2657] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:24.504525 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:24.506435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:24.566417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f8ba0-0cea-43b2-a9f7-29850338965e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:24.570066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:24.570662 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:24.570935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:24.571203 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:24.580747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:24.582534 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:24.592055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1327/2658] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:24 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:25.152749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:25.227686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00207b41-5d54-4513-8038-1fb274f0f15c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:25.233097 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:25.235100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.235100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.235633 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] PATH_INFO: `/v3/users/beaf7657188141f69ee224c9dd94b85d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.237287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beaf7657188141f69ee224c9dd94b85d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:25.239322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:25.251822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:25.253529 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.270996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92ba1b-5649-4f03-927e-fbfdac91aa63 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:25.281536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:25.282669 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.282945 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.283266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] PATH_INFO: `/v3/users/fca79c6c0ee84b8cbc98e4d4a6ea0994` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.284671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fca79c6c0ee84b8cbc98e4d4a6ea0994)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:25.287190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:25.307366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beaf7657188141f69ee224c9dd94b85d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.318675 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beaf7657188141f69ee224c9dd94b85d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.330697 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beaf7657188141f69ee224c9dd94b85d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.331455 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beaf7657188141f69ee224c9dd94b85d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.345498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8e4ec8bf-a703-4246-9666-c1a8aba8f997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beaf7657188141f69ee224c9dd94b85d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.350355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fca79c6c0ee84b8cbc98e4d4a6ea0994'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.352240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1332/2659] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:25 2022] DELETE /identity/v3/users/beaf7657188141f69ee224c9dd94b85d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:25.356906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.357100 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.357327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.358449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fca79c6c0ee84b8cbc98e4d4a6ea0994'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.371805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fca79c6c0ee84b8cbc98e4d4a6ea0994'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.372550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fca79c6c0ee84b8cbc98e4d4a6ea0994'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.373239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c3c21e34-fd50-4786-8ffd-88151a90d694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fca79c6c0ee84b8cbc98e4d4a6ea0994'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.377206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:25.378442 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.389435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1328/2660] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:25 2022] DELETE /identity/v3/users/fca79c6c0ee84b8cbc98e4d4a6ea0994 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:25.393790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.394076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.395056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.415482 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:25.416601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.435339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:25.448533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1333/2661] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:25.459872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:25.466437 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.481253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:25.495938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1329/2662] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:25.505701 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:25.507150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.527238 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3120e4-ca3b-4162-b29f-26cccd2ac747 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:25.567536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fecb1-10bf-4626-be8e-d3fc20131b59 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:25.572134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:25.573088 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.573887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.574167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.580703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:25.581414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.581701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.582284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.585166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:25.586708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:25.596429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:25.597918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:25.598874 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1330/2663] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:47:25.608924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1334/2664] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:47:25.813310 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:25.815095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.833512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109543d5-6862-47b3-bec7-afa526127f29 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:25.840437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:25.842241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.843048 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.843474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] PATH_INFO: `/v3/projects/ddfcc1b28de34239881bacda21458f79` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.844855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddfcc1b28de34239881bacda21458f79)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:25.846943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:25.918795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddfcc1b28de34239881bacda21458f79', 'request_id': 'req-ad845199-8a0d-46fa-89f6-b338fbf04082'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.930017 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddfcc1b28de34239881bacda21458f79', 'request_id': 'req-ad845199-8a0d-46fa-89f6-b338fbf04082'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.931728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:25.933217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:25.937545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddfcc1b28de34239881bacda21458f79', 'request_id': 'req-ad845199-8a0d-46fa-89f6-b338fbf04082'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.950848 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7e354-38cb-4a5b-83aa-265883733ddf service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:25.955271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] The token cache is being invalidate because project ddfcc1b28de34239881bacda21458f79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:25.955657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.956389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ad845199-8a0d-46fa-89f6-b338fbf04082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:25.962002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1331/2665] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:25 2022] DELETE /identity/v3/projects/ddfcc1b28de34239881bacda21458f79 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:25.963304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93f15-10ee-4603-b23b-0227740550f5 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:25.963711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93f15-10ee-4603-b23b-0227740550f5 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:25.963866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc93f15-10ee-4603-b23b-0227740550f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:25.988450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-ebc93f15-10ee-4603-b23b-0227740550f5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:25.989775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ebc93f15-10ee-4603-b23b-0227740550f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.016822 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.017499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.017780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.018056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] PATH_INFO: `/v3/projects/61fe605cc0d64fc2b3aed95cceb7a2fa` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.019256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61fe605cc0d64fc2b3aed95cceb7a2fa)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.021199 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.033835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:26.058466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1332/2666] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:26.068206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd774934-38ee-42de-914c-37fc1027619a None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.068490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd774934-38ee-42de-914c-37fc1027619a None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.068764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd774934-38ee-42de-914c-37fc1027619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.072352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61fe605cc0d64fc2b3aed95cceb7a2fa', 'request_id': 'req-45c03acb-0967-4696-9968-05e1c99cd463'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.081636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61fe605cc0d64fc2b3aed95cceb7a2fa', 'request_id': 'req-45c03acb-0967-4696-9968-05e1c99cd463'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.088949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61fe605cc0d64fc2b3aed95cceb7a2fa', 'request_id': 'req-45c03acb-0967-4696-9968-05e1c99cd463'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.090513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-fd774934-38ee-42de-914c-37fc1027619a None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:26.091782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fd774934-38ee-42de-914c-37fc1027619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.106352 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] The token cache is being invalidate because project 61fe605cc0d64fc2b3aed95cceb7a2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:26.106969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.107950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.110322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1335/2667] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:25 2022] DELETE /identity/v3/projects/61fe605cc0d64fc2b3aed95cceb7a2fa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:26.116102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.118085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.125273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:26.178296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1333/2668] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:47:26.182560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd774934-38ee-42de-914c-37fc1027619a None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.191864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd774934-38ee-42de-914c-37fc1027619a None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.196550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.197148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.197463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.197770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.198437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:26.198865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.200379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.204050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c03acb-0967-4696-9968-05e1c99cd463 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.209657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.210290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.210570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.210845 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] PATH_INFO: `/v3/users/0431c3ae739d4c0586e0509772ee1ad8` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.211982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0431c3ae739d4c0586e0509772ee1ad8)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.216502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1334/2669] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:47:26.216651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.218111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.228143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6481a00-1bc8-4978-97d0-29b3a47e27fe admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.232962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.233580 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.233861 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.234132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.234757 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.236659 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.264676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1335/2670] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:26 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:47:26.265292 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0431c3ae739d4c0586e0509772ee1ad8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.268728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.273016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0431c3ae739d4c0586e0509772ee1ad8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.281706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0431c3ae739d4c0586e0509772ee1ad8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.282843 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0431c3ae739d4c0586e0509772ee1ad8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.295096 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0431c3ae739d4c0586e0509772ee1ad8'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.301193 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1336/2671] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:26 2022] DELETE /identity/v3/users/0431c3ae739d4c0586e0509772ee1ad8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:26.335055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57293d1f-6d55-4a07-a8c8-cdddbd8ebf91 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.389998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:26.397099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.397889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.398187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.398473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.399318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.401760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.426454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1336/2672] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:26 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:47:26.430599 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.432229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.446273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317d3cf-b79a-4a3a-81f2-0baa3c465223 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.462403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.463036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.463316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.463589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.464248 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.465900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.477412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1337/2673] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:26.481049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.491187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04736a24-d631-4057-8bd1-77d32b8272c6 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.496420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3cb36-b39f-4e46-b478-3986a9265933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.497036 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3cb36-b39f-4e46-b478-3986a9265933 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.497314 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3cb36-b39f-4e46-b478-3986a9265933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.497627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3cb36-b39f-4e46-b478-3986a9265933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.498805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3cb36-b39f-4e46-b478-3986a9265933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.500398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3cb36-b39f-4e46-b478-3986a9265933 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.513095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1337/2674] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:26.517951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.528692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76845a3-ce7d-4ee4-8b2f-2c518dc2cad1 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.533312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.534003 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.534303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.534537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] PATH_INFO: `/v3/projects/aa01a2306e824ff7a96597d63f43e49c/users/392076db850647fb9e8700f69dc7136c/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.567638 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa01a2306e824ff7a96597d63f43e49c, user_id=392076db850647fb9e8700f69dc7136c, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.570375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.586945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1338/2675] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:26 2022] PUT /identity/v3/projects/aa01a2306e824ff7a96597d63f43e49c/users/392076db850647fb9e8700f69dc7136c/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:26.601892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.601892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.602225 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.633516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] MFA Rules not processed for user `392076db850647fb9e8700f69dc7136c`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:26.634749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.655551 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.657930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.720200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1338/2676] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:26.734251 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:26.741572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:26.743250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.753823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9912728-d99d-475b-a489-09e6aafee4a0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.759029 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.759676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.759960 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.760235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] PATH_INFO: `/v3/projects/8a7148f98ba94e38be793f881e4f82fa` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.761456 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7148f98ba94e38be793f881e4f82fa)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.763389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.809302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce316df-ce05-469f-a65e-dd20573efc1b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:26.820523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7148f98ba94e38be793f881e4f82fa', 'request_id': 'req-8199f598-40c7-475e-af86-c84957239701'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.830625 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7148f98ba94e38be793f881e4f82fa', 'request_id': 'req-8199f598-40c7-475e-af86-c84957239701'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.837807 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7148f98ba94e38be793f881e4f82fa', 'request_id': 'req-8199f598-40c7-475e-af86-c84957239701'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.851311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] The token cache is being invalidate because project 8a7148f98ba94e38be793f881e4f82fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:26.851662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.852274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-8199f598-40c7-475e-af86-c84957239701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:26.854114 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1339/2677] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:26 2022] DELETE /identity/v3/projects/8a7148f98ba94e38be793f881e4f82fa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:26.861005 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032209de-18bf-4e0e-827e-e1c9be642641 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.861311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032209de-18bf-4e0e-827e-e1c9be642641 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.861668 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032209de-18bf-4e0e-827e-e1c9be642641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.866127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:26.867043 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.867561 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.868215 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.872141 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.881998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-032209de-18bf-4e0e-827e-e1c9be642641 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:26.883215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-032209de-18bf-4e0e-827e-e1c9be642641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.915234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:26.944444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:26.945933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:26.949692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1340/2678] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:26.958429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:26.958714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:26.958983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:26.961231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1339/2679] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:47:26.985496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:26.987223 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:26.999056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1341/2680] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:27.002741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.017313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a108f0-31de-49d6-b5ff-cc9fc69a1837 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.024210 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.025111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.025583 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.026032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.026801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:27.027742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.028724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.046477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1340/2681] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:47:27.047978 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.069136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c0374-4eef-45f9-aeba-49ec6a9b06e7 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.081318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.082877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.082877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.083495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.084404 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.088507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.129225 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1342/2682] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:27 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:27.133447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.145149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2455b-d743-4a26-8479-6217819b5cce admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.213545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.214778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.215107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.215384 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.216029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.218821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.242532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1341/2683] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:27 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:47:27.246678 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.258733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14489b3-1b31-423c-af71-ed0bee09cc62 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.264273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.265431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.265552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.265872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.266523 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.268143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.289090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1343/2684] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:27.290385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.301964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213356c-84a1-40e6-aa71-91f3f696a935 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.308148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a913202-d431-4586-b8a9-ee488d7f8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.308741 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a913202-d431-4586-b8a9-ee488d7f8a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.309648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a913202-d431-4586-b8a9-ee488d7f8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.309648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a913202-d431-4586-b8a9-ee488d7f8a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.310422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a913202-d431-4586-b8a9-ee488d7f8a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.312158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a913202-d431-4586-b8a9-ee488d7f8a43 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.325374 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1342/2685] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:27.329432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.342218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe45e8-6999-477e-bc2d-cb52686cf056 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.347142 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.347800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.348073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.348533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] PATH_INFO: `/v3/projects/1d1fe14d53c44f5eb084e006b2ed4326/users/554681eb8ac44814a7bd2424311952f7/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.364612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1fe14d53c44f5eb084e006b2ed4326, user_id=554681eb8ac44814a7bd2424311952f7, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.367419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.387398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1344/2686] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:27 2022] PUT /identity/v3/projects/1d1fe14d53c44f5eb084e006b2ed4326/users/554681eb8ac44814a7bd2424311952f7/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:27.393235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d716a-d066-4b69-ba43-644f93aef86f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.393808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d716a-d066-4b69-ba43-644f93aef86f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.393808 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d716a-d066-4b69-ba43-644f93aef86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.423016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-755d716a-d066-4b69-ba43-644f93aef86f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:27.424494 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-755d716a-d066-4b69-ba43-644f93aef86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:27.518478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1343/2687] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:27.525616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:27.528178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:27.546239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:27.600186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8d958-dee1-4ac9-9da3-3fac8c2dc1ab admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:27.603964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:27.604655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:27.605002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:27.605339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:27.615189 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:27.616711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:27.626472 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1345/2688] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:28.449577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:28.450234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:28.450234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:28.483375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] MFA Rules not processed for user `554681eb8ac44814a7bd2424311952f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:28.484607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:28.530503 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:28.597379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1344/2689] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:28.597597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:28.605084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebeef25-0278-4b30-9878-05beb210be1f service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:28.612796 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:28.613614 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:28.613972 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:28.614324 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:28.615055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:28.617214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:28.658180 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1346/2690] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:28 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:28.662345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:28.678313 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4059e64-e271-4a2f-bed8-adba2180ea62 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:28.757054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:28.757717 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:28.758000 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:28.758611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:28.759239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:28.761437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:28.788435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1345/2691] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:28 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:28.792355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:28.805293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f015-8ba2-4919-b90f-25ade8a6955c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:28.811514 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:28.812607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:28.813287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:28.813628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:28.814479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:28.816332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:28.831721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1347/2692] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:28.836386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:28.847651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56913d78-6104-4edf-a161-62894236ad9c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:28.852784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:28.853821 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:28.854103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:28.854381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] PATH_INFO: `/v3/projects/45ad7db4690740b582db9139d3ebe234/users/7e1e9dd73a76480b9881cc2531475402/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:28.871058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ad7db4690740b582db9139d3ebe234, user_id=7e1e9dd73a76480b9881cc2531475402, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:28.874441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:28.891644 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1346/2693] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:28 2022] PUT /identity/v3/projects/45ad7db4690740b582db9139d3ebe234/users/7e1e9dd73a76480b9881cc2531475402/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:28.895799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:28.906667 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed7e13-16c2-4bd8-80aa-84aa80195e95 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:28.980785 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e14dc-6e03-44d2-b6eb-cb0ca3c03810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:28.981439 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e14dc-6e03-44d2-b6eb-cb0ca3c03810 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:28.981763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e14dc-6e03-44d2-b6eb-cb0ca3c03810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:28.981982 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e14dc-6e03-44d2-b6eb-cb0ca3c03810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:28.985841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e14dc-6e03-44d2-b6eb-cb0ca3c03810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:28.988657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e14dc-6e03-44d2-b6eb-cb0ca3c03810 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:29.002578 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1348/2694] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:29.006693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:29.018745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d4d47-afb7-439f-904a-4a11bdb4d48c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:29.024520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4189a-f63d-4509-a98d-2a35ec8ca02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:29.025220 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4189a-f63d-4509-a98d-2a35ec8ca02e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:29.025532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4189a-f63d-4509-a98d-2a35ec8ca02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:29.025806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4189a-f63d-4509-a98d-2a35ec8ca02e admin admin] PATH_INFO: `/v3/projects/45ad7db4690740b582db9139d3ebe234/users/7e1e9dd73a76480b9881cc2531475402/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:29.027750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4189a-f63d-4509-a98d-2a35ec8ca02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ad7db4690740b582db9139d3ebe234, user_id=7e1e9dd73a76480b9881cc2531475402, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:29.030510 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4189a-f63d-4509-a98d-2a35ec8ca02e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:29.041692 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1347/2695] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:29 2022] PUT /identity/v3/projects/45ad7db4690740b582db9139d3ebe234/users/7e1e9dd73a76480b9881cc2531475402/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:30.023546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:30.025006 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:30.025653 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:30.192491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] MFA Rules not processed for user `7e1e9dd73a76480b9881cc2531475402`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:30.194384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:30.272814 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1349/2696] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:30.277816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:30.278305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:30.278408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:30.299923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] MFA Rules not processed for user `554681eb8ac44814a7bd2424311952f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:30.301129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:30.478601 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1348/2697] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:30.490357 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:30.491786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:30.498264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:30.568655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8670a5-d9bc-46fe-a92d-f94397e68920 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:30.574013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:30.574615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:30.574889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:30.575156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:30.583146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:30.584702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:30.593788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1350/2698] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:30.824498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:30.856944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:30.885819 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b07748-21b0-44e1-b876-d9af7d70207d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:30.890891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:30.891921 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:30.892415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:30.892911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:30.895532 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:30.912683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:30.914166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:30.922890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1349/2699] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:32.158521 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:32.159917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:32.172413 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a1f54-dd9d-4976-af5d-bc6296148bda service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:32.175990 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:32.176576 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:32.176851 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:32.177147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:32.178842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:32.242412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:32.243851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:32.250587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:32.251825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21bfa19-3837-464a-92bd-4e3d1b285377 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:32.262517 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd804d-db8f-4653-af7e-621dc75fb0d5 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:32.266389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1351/2700] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:32.267845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:32.268795 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:32.269250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:32.269707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] PATH_INFO: `/v3/users/392076db850647fb9e8700f69dc7136c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:32.271504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392076db850647fb9e8700f69dc7136c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:32.273923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:32.345904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392076db850647fb9e8700f69dc7136c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.357573 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392076db850647fb9e8700f69dc7136c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.396143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392076db850647fb9e8700f69dc7136c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.397412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392076db850647fb9e8700f69dc7136c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.397566 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392076db850647fb9e8700f69dc7136c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.415288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1350/2701] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:32 2022] DELETE /identity/v3/users/392076db850647fb9e8700f69dc7136c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:32.419876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:32.420164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:32.420495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:32.453378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:32.453378 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:32.516971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1352/2702] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:32.526747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:32.528284 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:32.588953 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba364dc6-c584-4d34-ad98-2e320ead5634 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:32.593277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:32.593914 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:32.594194 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:32.594468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:32.603786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:32.605261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:32.615295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1351/2703] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:32.896000 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:32.897883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:32.913763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5209-415b-4199-8ad9-b803c2a712cb None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:32.919532 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:32.920295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:32.920660 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:32.920968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] PATH_INFO: `/v3/projects/aa01a2306e824ff7a96597d63f43e49c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:32.922275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa01a2306e824ff7a96597d63f43e49c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:32.925316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:32.952147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:32.982911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa01a2306e824ff7a96597d63f43e49c', 'request_id': 'req-c242ec95-131f-4b2b-b2a0-fe84b069b19e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.990577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa01a2306e824ff7a96597d63f43e49c', 'request_id': 'req-c242ec95-131f-4b2b-b2a0-fe84b069b19e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:32.996985 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa01a2306e824ff7a96597d63f43e49c', 'request_id': 'req-c242ec95-131f-4b2b-b2a0-fe84b069b19e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:33.009141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] The token cache is being invalidate because project aa01a2306e824ff7a96597d63f43e49c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:33.009474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:33.010118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:33.011914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1353/2704] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:32 2022] DELETE /identity/v3/projects/aa01a2306e824ff7a96597d63f43e49c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:36.830950 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:36.832770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:36.883373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:36.910559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c67548-ac99-4d1e-a3bd-aa06360fe786 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:36.922422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:36.923911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:36.988380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:36.989368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:36.989368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:36.989626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:36.991337 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:36.994894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242ec95-131f-4b2b-b2a0-fe84b069b19e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.000419 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.001178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.001589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.001967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] PATH_INFO: `/v3/users/06a40ad8ffc847028888ecda6221fcf4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.003214 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a40ad8ffc847028888ecda6221fcf4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.004095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.005655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.007269 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.024747 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1352/2705] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:37.082615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a40ad8ffc847028888ecda6221fcf4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.089540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a40ad8ffc847028888ecda6221fcf4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.097876 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a40ad8ffc847028888ecda6221fcf4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.098689 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a40ad8ffc847028888ecda6221fcf4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.114490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-b6060bec-96eb-4881-9d49-4ca75ee40b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a40ad8ffc847028888ecda6221fcf4'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.120593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1354/2706] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:47:36 2022] DELETE /identity/v3/users/06a40ad8ffc847028888ecda6221fcf4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:37.313832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.330973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9731d9-7e5c-4976-93cd-d553715b4a40 service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.390673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.391305 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.391675 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.391845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] PATH_INFO: `/v3/projects/1e0d3956303641d68d68dc5ae4f4cf17` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.392967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0d3956303641d68d68dc5ae4f4cf17)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.394926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.447078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0d3956303641d68d68dc5ae4f4cf17', 'request_id': 'req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.454804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0d3956303641d68d68dc5ae4f4cf17', 'request_id': 'req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.460894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0d3956303641d68d68dc5ae4f4cf17', 'request_id': 'req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.472835 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] The token cache is being invalidate because project 1e0d3956303641d68d68dc5ae4f4cf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:47:37.473118 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.473788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-ca6b5bfa-c12e-4383-a767-f2d2fff7cdea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:47:37.475274 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1353/2707] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:47:37 2022] DELETE /identity/v3/projects/1e0d3956303641d68d68dc5ae4f4cf17 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:47:37.480247 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.480534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.480805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.500767 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:37.502002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:37.522286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:37.564268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1355/2708] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:37.572714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.572980 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.573258 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.593964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:37.595192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:37.602844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1354/2709] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:37.607087 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.617048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7a148-103e-4668-9dea-d964fcd3090f None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.621570 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.622160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.622483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.622764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.623410 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:47:37.623710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.625322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.636819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1356/2710] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:47:37.641806 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.646246 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:37.652283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eac4eb-ba7d-453c-a984-849095adea16 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.658812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.659403 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.659676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.659939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.660565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.662479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.689277 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1355/2711] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:47:37 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:37.693776 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.704828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1427dd9-7341-4a9d-8897-699045b0fd5b admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.761278 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.761908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.762186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.762451 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.763655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.765581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.787192 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1357/2712] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:47:37 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:47:37.791449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.802154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b3b0d-f14e-4a25-8ff1-0b6178878724 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.806811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.807439 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.807716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.807988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.808628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.810273 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.820264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1356/2713] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:37.824665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.836230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7ea2c-469f-4472-b604-96380161fee2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.840862 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a87211c-52a2-4b9a-aab5-2f4358cf11ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.842047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87211c-52a2-4b9a-aab5-2f4358cf11ea admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.842327 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87211c-52a2-4b9a-aab5-2f4358cf11ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.842600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a87211c-52a2-4b9a-aab5-2f4358cf11ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.843240 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87211c-52a2-4b9a-aab5-2f4358cf11ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.844850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a87211c-52a2-4b9a-aab5-2f4358cf11ea admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.855665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1358/2714] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:47:37.859923 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:37.871350 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9a1930-6f91-4796-a884-8c47b2448324 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:37.876794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:37.877500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.877781 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.878055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] PATH_INFO: `/v3/projects/4e7763f5a36c4b9584467f9fc8bcbeb3/users/6352ad19d5114bb293a1358c3f071b9f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.893894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7763f5a36c4b9584467f9fc8bcbeb3, user_id=6352ad19d5114bb293a1358c3f071b9f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:37.896657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:37.909938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1357/2715] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:47:37 2022] PUT /identity/v3/projects/4e7763f5a36c4b9584467f9fc8bcbeb3/users/6352ad19d5114bb293a1358c3f071b9f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:47:37.915090 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf230f-ce3f-4a90-b748-fb1ccf8496a3 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:37.915466 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf230f-ce3f-4a90-b748-fb1ccf8496a3 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:37.915746 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf230f-ce3f-4a90-b748-fb1ccf8496a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:37.934283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-8dcf230f-ce3f-4a90-b748-fb1ccf8496a3 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:37.935507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-8dcf230f-ce3f-4a90-b748-fb1ccf8496a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:37.994753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1359/2716] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:38.004895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:38.006633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:38.068873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76e5f0-bc9e-430f-858a-9a170f6ec766 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:38.072579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:38.073179 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:38.073490 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:38.073934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:38.083964 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:38.085416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:38.094805 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1358/2717] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:42.500231 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d595ca-e6f5-429b-a657-0b74f45f7184 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:42.500865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d595ca-e6f5-429b-a657-0b74f45f7184 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:42.500865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d595ca-e6f5-429b-a657-0b74f45f7184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:42.538687 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-11d595ca-e6f5-429b-a657-0b74f45f7184 None None] MFA Rules not processed for user `6352ad19d5114bb293a1358c3f071b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:42.539915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-11d595ca-e6f5-429b-a657-0b74f45f7184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:42.564835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:42.630642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1360/2718] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:42.647585 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:42.650893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:42.738038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772252ab-2b8e-41cb-8705-84b20b4f1153 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:42.743931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:42.744554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:42.744830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:42.745103 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:42.754382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:42.756049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:42.768347 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1359/2719] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:44.252337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:44.252893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:44.252893 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:44.271783 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] MFA Rules not processed for user `6352ad19d5114bb293a1358c3f071b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:47:44.273008 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:44.280263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1361/2720] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:47:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:47:44.861925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:44.863444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:44.876037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a79d6-1412-4eb7-97ac-b8cb1d1b34c1 service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:44.879783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:44.880324 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:44.880602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:44.880870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:44.882658 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:44.892547 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:44.894128 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:44.902673 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1360/2721] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:45.390201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:45.394582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:45.493877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd4346-b3db-4418-ab69-db1e81a43719 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:45.499380 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:45.500157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:45.500544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:45.501043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:45.503160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:45.604795 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:45.608071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:45.621477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1362/2722] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:48.335609 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:47:48.364676 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff7978-235d-4c9c-ba1e-4b7e89698fa0 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:47:48.373030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:47:48.375077 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:47:48.375681 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:47:48.376116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:47:48.378511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:47:48.409735 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:47:48.411410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:47:48.425898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1361/2723] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:47:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:47:55.614943 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=70 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:47:58.419090 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:05.665216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:05.666813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:05.680924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5e109-6183-4d42-a9ad-7fb89ddaf779 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:05.686250 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:05.686924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:05.687204 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:05.687482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] PATH_INFO: `/v3/users/554681eb8ac44814a7bd2424311952f7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:05.689397 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=554681eb8ac44814a7bd2424311952f7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:05.691330 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:05.740516 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554681eb8ac44814a7bd2424311952f7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:05.747513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554681eb8ac44814a7bd2424311952f7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:05.754910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554681eb8ac44814a7bd2424311952f7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:05.755541 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554681eb8ac44814a7bd2424311952f7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:05.767636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554681eb8ac44814a7bd2424311952f7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:05.773506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1363/2724] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:48:05 2022] DELETE /identity/v3/users/554681eb8ac44814a7bd2424311952f7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:05.944249 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:05.955113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5fae9-24ef-4a78-a2b8-e4e79aad315f service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.025342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.025889 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.026223 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.026521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] PATH_INFO: `/v3/projects/1d1fe14d53c44f5eb084e006b2ed4326` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.028138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1fe14d53c44f5eb084e006b2ed4326)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.030072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.076413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1fe14d53c44f5eb084e006b2ed4326', 'request_id': 'req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.083335 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1fe14d53c44f5eb084e006b2ed4326', 'request_id': 'req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.088967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1fe14d53c44f5eb084e006b2ed4326', 'request_id': 'req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.101204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] The token cache is being invalidate because project 1d1fe14d53c44f5eb084e006b2ed4326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:48:06.101521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.102164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.103631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1362/2725] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:48:05 2022] DELETE /identity/v3/projects/1d1fe14d53c44f5eb084e006b2ed4326 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:06.107788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:06.109169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:06.122641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52905047-1305-41cf-a71f-98a2c1ddf489 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.183325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.184002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.184281 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.184553 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] PATH_INFO: `/v3/users/7e1e9dd73a76480b9881cc2531475402` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.185810 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1e9dd73a76480b9881cc2531475402)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.187789 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.239190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1e9dd73a76480b9881cc2531475402'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.246630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1e9dd73a76480b9881cc2531475402'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.254423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1e9dd73a76480b9881cc2531475402'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.255319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1e9dd73a76480b9881cc2531475402'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.265811 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:06.272328 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-229514c0-1130-4024-ba5f-2c87b36a963d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1e9dd73a76480b9881cc2531475402'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.280438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1364/2726] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:48:06 2022] DELETE /identity/v3/users/7e1e9dd73a76480b9881cc2531475402 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:06.459418 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:06.460802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:06.481034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c103b0f-dcd0-477b-97cd-8fbb5c17b85c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.542231 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.542762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.543074 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.543887 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] PATH_INFO: `/v3/projects/45ad7db4690740b582db9139d3ebe234` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.545009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ad7db4690740b582db9139d3ebe234)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.547031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.586142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:06.601786 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ad7db4690740b582db9139d3ebe234', 'request_id': 'req-1ea2b217-3a02-4886-b4d0-4b6edee6f160'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.610046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ad7db4690740b582db9139d3ebe234', 'request_id': 'req-1ea2b217-3a02-4886-b4d0-4b6edee6f160'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.616134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ad7db4690740b582db9139d3ebe234', 'request_id': 'req-1ea2b217-3a02-4886-b4d0-4b6edee6f160'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.628706 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] The token cache is being invalidate because project 45ad7db4690740b582db9139d3ebe234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:48:06.629126 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.630013 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1ea2b217-3a02-4886-b4d0-4b6edee6f160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:06.632192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1363/2727] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:48:06 2022] DELETE /identity/v3/projects/45ad7db4690740b582db9139d3ebe234 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:06.637641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.638091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.638513 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.664388 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:06.665642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:06.731681 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1365/2728] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:06.740355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.740622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.740894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.762366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:06.763578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:06.772521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1364/2729] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:06.776949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:06.787372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec873e17-394a-4bb7-a24b-6c59a577c07b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.792102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.792771 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.793063 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.793999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.794651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:48:06.794952 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.796527 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.809221 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1366/2730] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:48:06.813760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:06.823563 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b5ca-86dc-4d5a-b634-271f2e73115e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.828745 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.829857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.830139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.830407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.831056 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.833293 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.861412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1365/2731] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:48:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:48:06.865792 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:06.876202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971dc13-04f3-4243-8d68-220b2edd4c89 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.932273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.932870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.933148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.933459 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.934098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.935997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.957179 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1367/2732] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:48:06 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:48:06.961412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:06.972276 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79abb30-1b55-4451-80ca-7bc9045c5292 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:06.976860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:06.977485 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:06.977765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:06.978031 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:06.978666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:06.980260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:06.990029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1366/2733] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:48:06.993969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:07.004339 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb396f-10cd-4f6e-b6c0-38afde9bdd77 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:07.009111 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85234e-9a27-43a6-88b6-f97571a27f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:07.009662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85234e-9a27-43a6-88b6-f97571a27f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:07.009941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85234e-9a27-43a6-88b6-f97571a27f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:07.010212 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85234e-9a27-43a6-88b6-f97571a27f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:07.011217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85234e-9a27-43a6-88b6-f97571a27f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:07.012989 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85234e-9a27-43a6-88b6-f97571a27f5c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:07.024597 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1368/2734] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:48:07.029508 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:07.039664 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70a48-5c9a-47c7-897f-b43bced667a4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:07.044839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:07.045611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:07.045890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:07.046160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] PATH_INFO: `/v3/projects/fc06520e163b41c6bfa5a2e564a6da06/users/046717a1d17147dc83b7e7ea8b5406da/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:07.062152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc06520e163b41c6bfa5a2e564a6da06, user_id=046717a1d17147dc83b7e7ea8b5406da, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:07.064635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:07.079402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1367/2735] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:48:07 2022] PUT /identity/v3/projects/fc06520e163b41c6bfa5a2e564a6da06/users/046717a1d17147dc83b7e7ea8b5406da/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:07.090784 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:07.091158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:07.091503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:07.120970 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] MFA Rules not processed for user `046717a1d17147dc83b7e7ea8b5406da`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:07.122433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:07.172483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:07.192886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1369/2736] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:07.204204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:07.205947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:07.262784 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106141e-45a4-466c-be29-645532a7ad22 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:07.266366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4226-d66a-4e1d-8917-1bf9f92b7038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:07.266962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4226-d66a-4e1d-8917-1bf9f92b7038 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:07.267236 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4226-d66a-4e1d-8917-1bf9f92b7038 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:07.267501 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4226-d66a-4e1d-8917-1bf9f92b7038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:07.275857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4226-d66a-4e1d-8917-1bf9f92b7038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:07.277281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b4226-d66a-4e1d-8917-1bf9f92b7038 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:07.286412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1368/2737] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:12.682002 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:12.747823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9026b-ba03-4ef1-9ca9-ddc8983ac841 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:12.752412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:12.753047 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:12.753325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:12.753640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] PATH_INFO: `/v3/users/046717a1d17147dc83b7e7ea8b5406da` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:12.754768 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=046717a1d17147dc83b7e7ea8b5406da)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:12.756721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:12.806268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046717a1d17147dc83b7e7ea8b5406da'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:12.814589 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046717a1d17147dc83b7e7ea8b5406da'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:12.822834 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046717a1d17147dc83b7e7ea8b5406da'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:12.823566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046717a1d17147dc83b7e7ea8b5406da'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:12.836693 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046717a1d17147dc83b7e7ea8b5406da'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:12.845068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1370/2738] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:48:12 2022] DELETE /identity/v3/users/046717a1d17147dc83b7e7ea8b5406da => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:12.849621 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:12.850162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:12.850285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:12.872575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:12.873878 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:12.929429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:12.939919 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1369/2739] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:12.949739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:12.951310 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:13.011765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe212e-108e-41fa-adcf-31b2f38d88ef admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.015300 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5273-d7f3-46f4-b07e-b5f96280daf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.015905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5273-d7f3-46f4-b07e-b5f96280daf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.016185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5273-d7f3-46f4-b07e-b5f96280daf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.016456 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5273-d7f3-46f4-b07e-b5f96280daf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.025601 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b5273-d7f3-46f4-b07e-b5f96280daf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.027022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b5273-d7f3-46f4-b07e-b5f96280daf3 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.036356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1371/2740] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:13.327405 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.328912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:13.343028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd962fe4-62b0-45a4-a31b-b2457ac719a0 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.347788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.348339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.348616 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.349762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] PATH_INFO: `/v3/projects/fc06520e163b41c6bfa5a2e564a6da06` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.351256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc06520e163b41c6bfa5a2e564a6da06)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.353148 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.403377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc06520e163b41c6bfa5a2e564a6da06', 'request_id': 'req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:13.411401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc06520e163b41c6bfa5a2e564a6da06', 'request_id': 'req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:13.417010 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc06520e163b41c6bfa5a2e564a6da06', 'request_id': 'req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:13.429040 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] The token cache is being invalidate because project fc06520e163b41c6bfa5a2e564a6da06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:48:13.429300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:13.429967 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-6f7c6a34-26ed-42c1-b5d3-ccb88fd31331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:13.431446 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1370/2741] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:48:13 2022] DELETE /identity/v3/projects/fc06520e163b41c6bfa5a2e564a6da06 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:13.436386 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.436671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.436949 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.456420 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:13.457906 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:13.462099 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:13.518622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1372/2742] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:13.526120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.526406 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.526680 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.547155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:13.548361 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:13.556459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1371/2743] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:13.560996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.570758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc939e-8809-4c19-8fa3-8167097f21a2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.575917 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.576505 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.576799 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.577054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.577748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:48:13.578048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.579632 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.591996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1373/2744] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:48:13.596593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.606086 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c1f35-9afe-482c-a011-05aa1cd7e211 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.610708 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.611294 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.611567 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.611832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.612451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.614356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.641295 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1372/2745] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:48:13.645512 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.655560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e93bc6-71bc-4f16-a1a1-524f58cc6f3a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.712159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.712812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.713026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.713295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.713965 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.715889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.737105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1374/2746] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:48:13.741331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.752622 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584235a-1afe-4f07-ba10-07754271208f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.757321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.757963 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.758261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.758552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.759193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.760865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.770997 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1373/2747] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:48:13.774938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.786115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bad9b2-5093-442f-b697-d63cbd20562d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.790889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b421a865-b1ff-441f-bf60-378189fbc709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.791477 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a865-b1ff-441f-bf60-378189fbc709 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.791763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a865-b1ff-441f-bf60-378189fbc709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.792034 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421a865-b1ff-441f-bf60-378189fbc709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.792688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421a865-b1ff-441f-bf60-378189fbc709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.794803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b421a865-b1ff-441f-bf60-378189fbc709 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.806434 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1375/2748] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:48:13.811252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.821125 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044857f7-a54a-448f-983d-a06062207f94 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:13.825803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:13.826436 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.826716 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.826988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] PATH_INFO: `/v3/projects/0a6f662b2b6e4986aa25fca79bf2a299/users/e643c07b36f240c59af0034374ccc15d/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.842057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6f662b2b6e4986aa25fca79bf2a299, user_id=e643c07b36f240c59af0034374ccc15d, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:13.844704 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:13.859753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1374/2749] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:48:13 2022] PUT /identity/v3/projects/0a6f662b2b6e4986aa25fca79bf2a299/users/e643c07b36f240c59af0034374ccc15d/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:13.870158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:13.870535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:13.870815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:13.898809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] MFA Rules not processed for user `e643c07b36f240c59af0034374ccc15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:13.900017 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:13.963861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1376/2750] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:13.975133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:13.976941 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:14.033667 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cee13-87df-4f44-8d72-9e520b91ad35 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:14.037166 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254a53d9-2288-4dfd-ab39-0d8f645d7e87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:14.037800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a53d9-2288-4dfd-ab39-0d8f645d7e87 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:14.038079 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a53d9-2288-4dfd-ab39-0d8f645d7e87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:14.038380 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254a53d9-2288-4dfd-ab39-0d8f645d7e87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:14.046801 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a53d9-2288-4dfd-ab39-0d8f645d7e87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:14.048247 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254a53d9-2288-4dfd-ab39-0d8f645d7e87 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:14.057171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1375/2751] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:48:17.099604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:17.104922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:17.163414 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda22c2-5769-4bad-9696-bb703f651d8a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:17.168639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:17.169284 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:17.169593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:17.169852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] PATH_INFO: `/v3/users/e643c07b36f240c59af0034374ccc15d` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:17.170998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e643c07b36f240c59af0034374ccc15d)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:17.172914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:17.219209 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e643c07b36f240c59af0034374ccc15d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.226045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e643c07b36f240c59af0034374ccc15d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.234184 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e643c07b36f240c59af0034374ccc15d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.234842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e643c07b36f240c59af0034374ccc15d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.247152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e643c07b36f240c59af0034374ccc15d'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.253159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1377/2752] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:48:17 2022] DELETE /identity/v3/users/e643c07b36f240c59af0034374ccc15d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:17.257696 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:17.258197 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:17.258299 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:17.277872 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:17.279075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:17.296383 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:17.341761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1376/2753] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:17.351598 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:17.353084 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:17.414880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58664d3a-9cad-4379-ac9d-43de85a7efa3 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:17.418469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecd024-3121-49c2-ac4d-6b85c1af4b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:17.419071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd024-3121-49c2-ac4d-6b85c1af4b3f service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:17.419343 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd024-3121-49c2-ac4d-6b85c1af4b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:17.419611 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecd024-3121-49c2-ac4d-6b85c1af4b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:17.428636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecd024-3121-49c2-ac4d-6b85c1af4b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:17.430071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecd024-3121-49c2-ac4d-6b85c1af4b3f service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:17.439536 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1378/2754] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:48:17.725316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:48:17.726904 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:17.740304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61cdff-d2b0-4e86-8dba-049044a814aa None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:48:17.746338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:48:17.747016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:17.747353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:17.747688 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] PATH_INFO: `/v3/projects/0a6f662b2b6e4986aa25fca79bf2a299` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:17.748934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6f662b2b6e4986aa25fca79bf2a299)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:48:17.750949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:48:17.800836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6f662b2b6e4986aa25fca79bf2a299', 'request_id': 'req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.811472 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6f662b2b6e4986aa25fca79bf2a299', 'request_id': 'req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.817689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6f662b2b6e4986aa25fca79bf2a299', 'request_id': 'req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.829402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] The token cache is being invalidate because project 0a6f662b2b6e4986aa25fca79bf2a299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:48:17.829693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.830331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:48:17.832058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1377/2755] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:48:17 2022] DELETE /identity/v3/projects/0a6f662b2b6e4986aa25fca79bf2a299 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:48:27.435131 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:27.826404 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:48:38.454105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:48:38.454604 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:48:38.454702 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:48:38.474124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] MFA Rules not processed for user `6352ad19d5114bb293a1358c3f071b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:48:38.475336 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:48:38.529801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1379/2756] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:48:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:48:48.523216 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=25 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:40.904592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:40.907600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:41.058355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a090f3-ed2e-4eeb-af62-6f69850f6f55 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:41.063942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:41.064589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:41.064864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:41.065187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] PATH_INFO: `/v3/users/677db3483143470a965cc36a2add51ee` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:41.066338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] RBAC: Authorizing `identity:delete_user(user_id=677db3483143470a965cc36a2add51ee)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:41.068398 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:41.116581 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677db3483143470a965cc36a2add51ee'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.123382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677db3483143470a965cc36a2add51ee'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.136318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677db3483143470a965cc36a2add51ee'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.137058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677db3483143470a965cc36a2add51ee'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.137682 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677db3483143470a965cc36a2add51ee'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.153297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1378/2757] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:49:40 2022] DELETE /identity/v3/users/677db3483143470a965cc36a2add51ee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:49:41.341496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:41.391797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c99602-87d7-4c38-97ac-ab2c56266461 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:41.463369 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:41.464139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:41.464464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:41.464794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] PATH_INFO: `/v3/projects/97b7e95dd9dd467791a0f76f54287ae4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:41.466165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b7e95dd9dd467791a0f76f54287ae4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:41.468220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:41.527964 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b7e95dd9dd467791a0f76f54287ae4', 'request_id': 'req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.536758 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b7e95dd9dd467791a0f76f54287ae4', 'request_id': 'req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.542756 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b7e95dd9dd467791a0f76f54287ae4', 'request_id': 'req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.555957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] The token cache is being invalidate because project 97b7e95dd9dd467791a0f76f54287ae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:49:41.556275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.557014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-fdeb63b9-d1c7-4cc8-af97-72ba9d94f567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.558857 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1380/2758] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:49:41 2022] DELETE /identity/v3/projects/97b7e95dd9dd467791a0f76f54287ae4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:49:41.564259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:41.566381 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:41.586844 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88847b7-8321-44f3-a795-4fbe72ea777e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:41.603234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:41.657788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:41.658467 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:41.658762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:41.659038 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] PATH_INFO: `/v3/users/538bac0f4c2c46e58c7e25e664256199` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:41.660192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=538bac0f4c2c46e58c7e25e664256199)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:41.662353 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:41.711912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '538bac0f4c2c46e58c7e25e664256199'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.719107 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '538bac0f4c2c46e58c7e25e664256199'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.731584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '538bac0f4c2c46e58c7e25e664256199'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.732298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '538bac0f4c2c46e58c7e25e664256199'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.733068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '538bac0f4c2c46e58c7e25e664256199'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:41.745820 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1379/2759] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:49:41 2022] DELETE /identity/v3/users/538bac0f4c2c46e58c7e25e664256199 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:49:41.905055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:41.905429 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:41.905641 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:41.926515 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] MFA Rules not processed for user `6352ad19d5114bb293a1358c3f071b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:49:41.928997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:41.935554 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:41.937560 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:41.996777 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1381/2760] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:49:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:49:42.023244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870655cc-993f-4b60-a10b-98698514f336 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:42.030906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:42.031651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:42.033154 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:42.033699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] PATH_INFO: `/v3/projects/721b545ba70644cca4c4ad15f09cc5e3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:42.035023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=721b545ba70644cca4c4ad15f09cc5e3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:42.037427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:42.101177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:42.110957 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '721b545ba70644cca4c4ad15f09cc5e3', 'request_id': 'req-93cf7b13-193d-4d70-bf1b-7825d94610d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:42.120069 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '721b545ba70644cca4c4ad15f09cc5e3', 'request_id': 'req-93cf7b13-193d-4d70-bf1b-7825d94610d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:42.126996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '721b545ba70644cca4c4ad15f09cc5e3', 'request_id': 'req-93cf7b13-193d-4d70-bf1b-7825d94610d8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:42.138782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] The token cache is being invalidate because project 721b545ba70644cca4c4ad15f09cc5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:49:42.139162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:42.139983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-93cf7b13-193d-4d70-bf1b-7825d94610d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:49:42.142456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1380/2761] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:49:41 2022] DELETE /identity/v3/projects/721b545ba70644cca4c4ad15f09cc5e3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:49:43.140239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:49:43.142156 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:43.166686 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:43.254048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39738564-d81a-4e77-a595-7ef0072c1342 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:49:43.317479 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:49:43.318089 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:49:43.318366 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:49:43.318636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:49:43.320390 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:49:43.332607 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:49:43.334279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:49:43.343998 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1382/2762] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:49:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:49:52.135725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:49:53.339805 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=66 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:50:38.343120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:50:38.343683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:50:38.343683 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:50:38.362720 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] MFA Rules not processed for user `6352ad19d5114bb293a1358c3f071b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:50:38.363930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:50:38.418902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1381/2763] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:50:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:50:48.412443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=25 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:23.560143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:23.561605 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:23.637830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6321-1a5a-4ba2-973e-8398ed0476d6 service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:23.641400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:23.641992 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:23.642264 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:23.643139 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:23.644860 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:23.735458 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:23.736813 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:23.757921 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1383/2764] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:25.306155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:25.307579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:25.320109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2aa1b-18d1-4205-8a58-034ca4a5ba7f None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:25.323685 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:25.324264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:25.324537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:25.324800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:25.326447 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:25.340486 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:25.341942 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:25.352796 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1382/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:33.755270 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=75 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:35.347891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:37.809071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:37.810530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:37.878885 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9293c9f-cc32-4fb0-842d-6088f0e0794b service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:37.883387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:37.884014 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:37.884316 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:37.884584 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] PATH_INFO: `/v3/users/6352ad19d5114bb293a1358c3f071b9f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:37.885750 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6352ad19d5114bb293a1358c3f071b9f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:37.887651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:37.933140 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6352ad19d5114bb293a1358c3f071b9f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:37.940423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6352ad19d5114bb293a1358c3f071b9f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:37.947376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6352ad19d5114bb293a1358c3f071b9f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:37.947999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6352ad19d5114bb293a1358c3f071b9f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:37.960911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0245e3de-6cbf-4501-aee4-143a5a5b991a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6352ad19d5114bb293a1358c3f071b9f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:37.966782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1384/2766] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:37 2022] DELETE /identity/v3/users/6352ad19d5114bb293a1358c3f071b9f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:38.141516 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.158924 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140f17a-d06d-4e65-bf6c-360683f2ff7c service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.226379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.227030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.227308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.227579 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] PATH_INFO: `/v3/projects/4e7763f5a36c4b9584467f9fc8bcbeb3` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.228711 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7763f5a36c4b9584467f9fc8bcbeb3)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.230651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.281343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7763f5a36c4b9584467f9fc8bcbeb3', 'request_id': 'req-d3465a69-6477-4afc-9784-288617130da3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:38.288602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7763f5a36c4b9584467f9fc8bcbeb3', 'request_id': 'req-d3465a69-6477-4afc-9784-288617130da3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:38.294161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7763f5a36c4b9584467f9fc8bcbeb3', 'request_id': 'req-d3465a69-6477-4afc-9784-288617130da3'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:38.305466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] The token cache is being invalidate because project 4e7763f5a36c4b9584467f9fc8bcbeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:38.305753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:38.306385 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-d3465a69-6477-4afc-9784-288617130da3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:38.307864 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1383/2767] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:38 2022] DELETE /identity/v3/projects/4e7763f5a36c4b9584467f9fc8bcbeb3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:51:38.312794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.313024 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.313295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.370757 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:38.371966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:38.421662 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:38.438227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1385/2768] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:38.449483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.449765 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.450039 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.469571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:38.470770 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:38.478536 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1384/2769] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:38.482868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.493118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07046d-896d-4787-aed1-d0e3d54cd896 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.497665 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.498263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.498542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.498816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.499469 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:51:38.499775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.501446 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.513466 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1386/2770] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:51:38.517752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.526859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2799-a7a9-43b2-a801-6675ad7ff979 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.531457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.532044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.532320 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.532589 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.533818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.535702 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.572443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1385/2771] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:38 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:38.576497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.586850 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfabd0-21ae-4e41-bce1-2a8f77e1b3da admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.644396 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.644999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.645280 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.645580 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.646213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.648122 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.669650 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1387/2772] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:38 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:38.674511 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.685011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af3363-1127-4efe-ba54-7ab4895e1812 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.689851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.690451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.690728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.691001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.691649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.693270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.703686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1386/2773] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:38.708371 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.718939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e2843-2f05-4173-b594-258347e844bc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.724025 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422ac33-4f0d-4405-9eb7-2d807be0495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.724617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ac33-4f0d-4405-9eb7-2d807be0495b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.724899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ac33-4f0d-4405-9eb7-2d807be0495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.725165 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422ac33-4f0d-4405-9eb7-2d807be0495b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.725832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ac33-4f0d-4405-9eb7-2d807be0495b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.727471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422ac33-4f0d-4405-9eb7-2d807be0495b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.738054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1388/2774] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:38.742190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.752660 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c5b12-5d22-4685-b491-e5f8b90dfc53 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.757600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.758244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.758526 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.758800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] PATH_INFO: `/v3/projects/83a28eedcaa940598987ca04db0ece1b/users/e2823e75dc744850b9f4a92190ea32a7/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.773831 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a28eedcaa940598987ca04db0ece1b, user_id=e2823e75dc744850b9f4a92190ea32a7, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.776527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:38.790131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1387/2775] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:38 2022] PUT /identity/v3/projects/83a28eedcaa940598987ca04db0ece1b/users/e2823e75dc744850b9f4a92190ea32a7/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:38.802376 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.802717 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.803028 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.832791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] MFA Rules not processed for user `e2823e75dc744850b9f4a92190ea32a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:38.833947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:38.898571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1389/2776] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:38.903070 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:38.921996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:38.967066 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ac0ac-c8eb-4dff-9642-5a1b3f3b0e2e admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:38.971756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:38.972355 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:38.972638 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:38.972912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:38.973565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:38.975480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.002521 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1388/2777] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:38 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:39.006900 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.017714 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d1ae5-e8cc-450a-8ee2-4a17318a5f52 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.060344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:39.076331 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.076929 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.077202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.077499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.078348 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.080037 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.101812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1390/2778] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:39 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:39.105856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.116890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb3e40-439f-43db-8082-c15be53ebe3f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.121550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.122145 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.122425 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.122698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.123329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.124918 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.136888 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1389/2779] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:39.141285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.153840 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e26d1-4f3d-4457-996a-d53cd07ebf1a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.159211 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.159864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.160141 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.160408 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] PATH_INFO: `/v3/projects/de544a743bfc46e8b267d89a52299f54/users/20ab29a847cc47cea3862a9d3d2576be/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.175202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de544a743bfc46e8b267d89a52299f54, user_id=20ab29a847cc47cea3862a9d3d2576be, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.177846 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.190487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1391/2780] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:39 2022] PUT /identity/v3/projects/de544a743bfc46e8b267d89a52299f54/users/20ab29a847cc47cea3862a9d3d2576be/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:51:39.194449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.204322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5039-f69d-46bf-8775-6cb0d45db5aa admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.260890 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6756f5-2bba-46c3-88a6-a021b79618f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.261611 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6756f5-2bba-46c3-88a6-a021b79618f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.261894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6756f5-2bba-46c3-88a6-a021b79618f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.262164 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6756f5-2bba-46c3-88a6-a021b79618f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.262802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6756f5-2bba-46c3-88a6-a021b79618f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.264394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6756f5-2bba-46c3-88a6-a021b79618f8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.274832 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1390/2781] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:39.278987 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.288988 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e103fc-1ca8-45c6-9053-b1edbfd8d46e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.293654 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.294291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.294566 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.294833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] PATH_INFO: `/v3/projects/de544a743bfc46e8b267d89a52299f54/users/20ab29a847cc47cea3862a9d3d2576be/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.296688 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de544a743bfc46e8b267d89a52299f54, user_id=20ab29a847cc47cea3862a9d3d2576be, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.299552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.309418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1392/2782] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:39 2022] PUT /identity/v3/projects/de544a743bfc46e8b267d89a52299f54/users/20ab29a847cc47cea3862a9d3d2576be/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:51:39.320037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.320322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.320606 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.348317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] MFA Rules not processed for user `20ab29a847cc47cea3862a9d3d2576be`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:39.349545 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:39.423301 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1391/2783] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:39.435694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.437449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:39.497163 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ae017-9c2b-4440-af2e-b0ee64edfd6a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.500870 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.501511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.502297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.502567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.511692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.513116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.523159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1393/2784] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:39.601966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:39.613417 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab77d1-7036-41b4-a18a-fe47110ad890 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:39.616946 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c8809-80fd-44fd-944a-0ee91379157d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:39.617571 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8809-80fd-44fd-944a-0ee91379157d service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:39.617845 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8809-80fd-44fd-944a-0ee91379157d service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:39.618127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c8809-80fd-44fd-944a-0ee91379157d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:39.628033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:39.679829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c8809-80fd-44fd-944a-0ee91379157d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:39.681188 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c8809-80fd-44fd-944a-0ee91379157d service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:39.690906 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1392/2785] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:46.462743 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:46.524149 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5d0cb-456a-4de8-be48-a00a0095cd74 service cinder] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:46.528694 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:46.529311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:46.529636 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:46.529910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] PATH_INFO: `/v3/users/e2823e75dc744850b9f4a92190ea32a7` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:46.531027 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2823e75dc744850b9f4a92190ea32a7)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:46.532939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:46.577509 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:46.583467 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2823e75dc744850b9f4a92190ea32a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:46.591924 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2823e75dc744850b9f4a92190ea32a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:46.599128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2823e75dc744850b9f4a92190ea32a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:46.599737 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2823e75dc744850b9f4a92190ea32a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:46.612256 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2823e75dc744850b9f4a92190ea32a7'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:46.618304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1394/2786] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:46 2022] DELETE /identity/v3/users/e2823e75dc744850b9f4a92190ea32a7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:46.622686 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:46.623207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:46.623411 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:46.642707 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:46.643897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:46.703146 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1393/2787] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:46.713289 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:46.714718 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:46.793643 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a21980-9b5d-4707-bfd5-9e8aedb7605a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:46.797311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:46.797938 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:46.798215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:46.798482 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:46.807933 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:46.809373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:46.818773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1395/2788] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:47.089483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:47.090935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:47.109098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0a01b-a27e-4b0d-8af3-eeaeda1bca22 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:47.117396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:47.118954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:47.118954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:47.118954 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] PATH_INFO: `/v3/projects/83a28eedcaa940598987ca04db0ece1b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:47.120471 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a28eedcaa940598987ca04db0ece1b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:47.123229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:47.175852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a28eedcaa940598987ca04db0ece1b', 'request_id': 'req-b5566b87-1fd3-4107-845e-4c6f771d17b0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.183632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a28eedcaa940598987ca04db0ece1b', 'request_id': 'req-b5566b87-1fd3-4107-845e-4c6f771d17b0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.190454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a28eedcaa940598987ca04db0ece1b', 'request_id': 'req-b5566b87-1fd3-4107-845e-4c6f771d17b0'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.201339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] The token cache is being invalidate because project 83a28eedcaa940598987ca04db0ece1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:47.201654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.202479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.204005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1394/2789] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:47 2022] DELETE /identity/v3/projects/83a28eedcaa940598987ca04db0ece1b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:47.208345 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:47.218147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81289905-3f42-4308-9da0-5c0482011250 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:47.276585 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:47.277233 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:47.277540 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:47.277808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] PATH_INFO: `/v3/users/20ab29a847cc47cea3862a9d3d2576be` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:47.281104 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ab29a847cc47cea3862a9d3d2576be)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:47.284118 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:47.333070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:47.336510 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ab29a847cc47cea3862a9d3d2576be'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.345031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ab29a847cc47cea3862a9d3d2576be'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.352423 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ab29a847cc47cea3862a9d3d2576be'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.353044 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ab29a847cc47cea3862a9d3d2576be'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.366016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a65decd-2aa9-40c8-ab84-324a4888cf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ab29a847cc47cea3862a9d3d2576be'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.371833 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1396/2790] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:47 2022] DELETE /identity/v3/users/20ab29a847cc47cea3862a9d3d2576be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:47.677429 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:47.679046 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:47.697465 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5566b87-1fd3-4107-845e-4c6f771d17b0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:47.733317 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:47.760990 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:47.761666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:47.761949 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:47.762624 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] PATH_INFO: `/v3/projects/de544a743bfc46e8b267d89a52299f54` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:47.763407 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de544a743bfc46e8b267d89a52299f54)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:47.765592 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:47.814162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de544a743bfc46e8b267d89a52299f54', 'request_id': 'req-189db30b-5342-4d26-863f-3e46b11d7a14'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.821366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de544a743bfc46e8b267d89a52299f54', 'request_id': 'req-189db30b-5342-4d26-863f-3e46b11d7a14'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.826986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de544a743bfc46e8b267d89a52299f54', 'request_id': 'req-189db30b-5342-4d26-863f-3e46b11d7a14'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.838278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] The token cache is being invalidate because project de544a743bfc46e8b267d89a52299f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:47.838559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.839183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-189db30b-5342-4d26-863f-3e46b11d7a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:47.840648 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1395/2791] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:47 2022] DELETE /identity/v3/projects/de544a743bfc46e8b267d89a52299f54 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:47.846102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:47.846612 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:47.846723 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:47.867969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:47.869172 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:47.929819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1397/2792] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:47.939443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:47.939760 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:47.940034 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:47.960243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:47.961463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:47.969233 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1396/2793] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:47.974218 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:47.984205 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc60a4-9034-42c3-8646-883ddb9ca018 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:47.988721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:47.989318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:47.989630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:47.989907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:47.990582 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:51:47.990886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:47.992480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.004957 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1398/2794] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:51:48.010466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.020804 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ad6f3-0da8-4908-8642-b15f3d956c64 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.025737 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.026329 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.026603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.026868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.027491 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.029392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.058298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1397/2795] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:48 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:51:48.062745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.072852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588383a4-fa83-437c-8c93-c7b5635117f0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.130227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.130825 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.131105 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.131377 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.132013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.134011 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.157043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1399/2796] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:48 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:48.161974 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.172367 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4c3eb-a212-4482-9eb4-7844d679996b admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.176965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.177586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.177867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.178142 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.178777 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.180365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.190187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1398/2797] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:48.194036 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.205444 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74392844-2fa7-417f-ad68-318ecbf92e06 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.210967 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dff35c-8915-48aa-a302-02139de0e9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.211572 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff35c-8915-48aa-a302-02139de0e9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.211852 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff35c-8915-48aa-a302-02139de0e9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.212126 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dff35c-8915-48aa-a302-02139de0e9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.212773 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff35c-8915-48aa-a302-02139de0e9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.214399 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dff35c-8915-48aa-a302-02139de0e9e3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.226070 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1400/2798] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:51:48.230304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.240626 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bdc52-3199-40e9-b535-dc08c222fbbb admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.245206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.245883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.246155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.246423 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] PATH_INFO: `/v3/projects/45d327b95d6d4132adb2d6298ad4eda6/users/03589777b8ce4d9a9b4fabf03676fb02/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.262106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d327b95d6d4132adb2d6298ad4eda6, user_id=03589777b8ce4d9a9b4fabf03676fb02, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.264725 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.278177 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1399/2799] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:48 2022] PUT /identity/v3/projects/45d327b95d6d4132adb2d6298ad4eda6/users/03589777b8ce4d9a9b4fabf03676fb02/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:48.288454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.288741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.289041 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.319321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] MFA Rules not processed for user `03589777b8ce4d9a9b4fabf03676fb02`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:48.320528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:48.333918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:48.386656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1401/2800] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:51:48.391382 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.452684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983038ea-f960-4216-9932-a361bd7602c1 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.458151 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.458746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.459022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.459290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.459926 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.461837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.467162 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:48.489802 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1400/2801] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:48 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:48.494101 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.505106 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f1e84-e645-4598-aae9-063ea130cb7c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.560361 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.560997 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.561277 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.561569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] PATH_INFO: `/v3/users` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.562206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.564102 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.586461 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1402/2802] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:48 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:48.590478 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.600905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e6747-c7d5-424c-a691-cb5a56dfb8f5 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.605605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.606202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.606481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.606750 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.607386 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.608979 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.620613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1401/2803] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:48.624691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.635124 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2bd9-b061-481c-8961-ddf95489d5da admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.640272 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.641004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.641283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.641615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] PATH_INFO: `/v3/projects/dd6737e0935d4d18923668a0234520a1/users/e933b34c35d245caa3e25b35fdf4623d/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.656642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6737e0935d4d18923668a0234520a1, user_id=e933b34c35d245caa3e25b35fdf4623d, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.659418 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.672552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1403/2804] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:48 2022] PUT /identity/v3/projects/dd6737e0935d4d18923668a0234520a1/users/e933b34c35d245caa3e25b35fdf4623d/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:48.677343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.687932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a319-7eb3-4840-91ea-b827a0b0932f admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.744461 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71196e8-4c9e-4dd1-b1ae-5c3350ac7dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.744995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71196e8-4c9e-4dd1-b1ae-5c3350ac7dcc admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.745263 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71196e8-4c9e-4dd1-b1ae-5c3350ac7dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.745565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71196e8-4c9e-4dd1-b1ae-5c3350ac7dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.746373 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71196e8-4c9e-4dd1-b1ae-5c3350ac7dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.747793 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71196e8-4c9e-4dd1-b1ae-5c3350ac7dcc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.758180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1402/2805] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:48.763074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.773699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b03d6-4920-441e-8ec9-514302b54a1c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.778297 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.778944 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.779332 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.779499 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] PATH_INFO: `/v3/projects/dd6737e0935d4d18923668a0234520a1/users/e933b34c35d245caa3e25b35fdf4623d/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.781463 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6737e0935d4d18923668a0234520a1, user_id=e933b34c35d245caa3e25b35fdf4623d, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.784188 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:48.794387 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1404/2806] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:48 2022] PUT /identity/v3/projects/dd6737e0935d4d18923668a0234520a1/users/e933b34c35d245caa3e25b35fdf4623d/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:48.805261 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.805670 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.805969 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.833932 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] MFA Rules not processed for user `e933b34c35d245caa3e25b35fdf4623d`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:48.835135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:48.907391 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1403/2807] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:48.919295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:48.920999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:48.978494 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74274f3b-8166-4dd9-8036-2b1989cd77c2 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:48.982167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14021d-ea1f-44df-99e5-9263c16acd4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:48.982766 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14021d-ea1f-44df-99e5-9263c16acd4f service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:48.983053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14021d-ea1f-44df-99e5-9263c16acd4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:48.983321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14021d-ea1f-44df-99e5-9263c16acd4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:48.992922 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14021d-ea1f-44df-99e5-9263c16acd4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:48.994370 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14021d-ea1f-44df-99e5-9263c16acd4f service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:49.004275 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1405/2808] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:49.402020 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:49.462252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:49.467201 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28d6c8-e161-475e-9671-e109526f0fd9 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:49.473607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:49.474235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:49.474512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:49.474800 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] PATH_INFO: `/v3/users/03589777b8ce4d9a9b4fabf03676fb02` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:49.475931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03589777b8ce4d9a9b4fabf03676fb02)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:49.477998 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:49.525143 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03589777b8ce4d9a9b4fabf03676fb02'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:49.532117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03589777b8ce4d9a9b4fabf03676fb02'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:49.544424 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03589777b8ce4d9a9b4fabf03676fb02'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:49.545099 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03589777b8ce4d9a9b4fabf03676fb02'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:49.545744 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03589777b8ce4d9a9b4fabf03676fb02'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:49.559111 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1404/2809] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:49 2022] DELETE /identity/v3/users/03589777b8ce4d9a9b4fabf03676fb02 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:49.564947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:49.565502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:49.566019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:49.586842 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:49.588032 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:49.592973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:49.655217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1406/2810] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:49.666232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:49.667646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:49.727712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da04d33-12c4-4611-8dcf-ae4de2544ea8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:49.731558 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:49.732163 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:49.732443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:49.732719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:49.742437 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:49.743893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:49.754030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1405/2811] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:50.018152 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:50.019794 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:50.032496 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ded1582-19de-4ef3-9016-04b3ee06f716 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:50.037144 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:50.037880 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.038226 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.038565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] PATH_INFO: `/v3/projects/45d327b95d6d4132adb2d6298ad4eda6` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.039791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d327b95d6d4132adb2d6298ad4eda6)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:50.041815 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:50.089628 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d327b95d6d4132adb2d6298ad4eda6', 'request_id': 'req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.098453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d327b95d6d4132adb2d6298ad4eda6', 'request_id': 'req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.104128 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d327b95d6d4132adb2d6298ad4eda6', 'request_id': 'req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.115764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] The token cache is being invalidate because project 45d327b95d6d4132adb2d6298ad4eda6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:50.116056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.116695 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.118220 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1407/2812] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:50 2022] DELETE /identity/v3/projects/45d327b95d6d4132adb2d6298ad4eda6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:50.122216 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:50.132474 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64068d0-a857-4fab-9b4d-dcfb7a07f896 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:50.191104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:50.191728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.192005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.192271 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] PATH_INFO: `/v3/users/e933b34c35d245caa3e25b35fdf4623d` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.193402 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e933b34c35d245caa3e25b35fdf4623d)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:50.195315 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:50.218288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:50.243487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e933b34c35d245caa3e25b35fdf4623d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.250388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e933b34c35d245caa3e25b35fdf4623d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.262131 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e933b34c35d245caa3e25b35fdf4623d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.262797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e933b34c35d245caa3e25b35fdf4623d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.263408 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-923ec67b-705b-4dc9-8887-d3d5dbc6815e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e933b34c35d245caa3e25b35fdf4623d'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.276699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1406/2813] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:50 2022] DELETE /identity/v3/users/e933b34c35d245caa3e25b35fdf4623d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:50.545342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:50.546830 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:50.561775 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574cf45-eafd-4e56-9e5a-5562c8a9eaae admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:50.623484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:50.624026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.624304 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.624574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] PATH_INFO: `/v3/projects/dd6737e0935d4d18923668a0234520a1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.625712 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6737e0935d4d18923668a0234520a1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:50.628812 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:50.670488 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:50.680112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6737e0935d4d18923668a0234520a1', 'request_id': 'req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.687317 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6737e0935d4d18923668a0234520a1', 'request_id': 'req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.693239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6737e0935d4d18923668a0234520a1', 'request_id': 'req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.704075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] The token cache is being invalidate because project dd6737e0935d4d18923668a0234520a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:50.704356 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.705618 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d7b9ed0b-ce4c-4f51-90ff-bef0eea9fc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:50.707373 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1408/2814] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:50 2022] DELETE /identity/v3/projects/dd6737e0935d4d18923668a0234520a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:50.712275 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.712557 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.712836 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.732228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:50.733457 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:50.792397 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1407/2815] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:50.800190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.800507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.800782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.821393 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:50.822602 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:50.831132 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1409/2816] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:50.835651 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:50.845221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092b4d1-6eaf-420c-bb35-511efd152985 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:50.850054 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:50.850653 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.850938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.851206 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.851852 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:51:50.852157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:50.853815 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:50.866113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1408/2817] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:51:50.870474 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:50.881908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091a1a2-2756-4f89-86ea-20ef609f90d8 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:50.886518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:50.887121 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.887400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.887671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.888299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:50.890274 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:50.916353 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1410/2818] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:50 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:50.920630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:50.931202 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece54d9-5e06-4358-9c29-397384c211cf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:50.987242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:50.987842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:50.988122 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:50.988392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:50.989024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:50.991026 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.012193 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1409/2819] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:50 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:51.016321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.026764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8630-812d-4982-a74e-d2c521cfce6a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.031295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.031888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.032166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.032441 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.033077 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.034721 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.044679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1411/2820] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:51.048591 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.059893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035cf60-8745-42da-bd3b-194fc6184ad9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.065144 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247c7cf-9643-4e80-b0b6-4138bdc0da1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.065775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c7cf-9643-4e80-b0b6-4138bdc0da1c admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.066057 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c7cf-9643-4e80-b0b6-4138bdc0da1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.066422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247c7cf-9643-4e80-b0b6-4138bdc0da1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.067260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247c7cf-9643-4e80-b0b6-4138bdc0da1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.068944 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247c7cf-9643-4e80-b0b6-4138bdc0da1c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.079943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1410/2821] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:51.084168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.094169 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f81154-6aff-4612-898f-98e32b269327 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.098817 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.099464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.099744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.100016 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] PATH_INFO: `/v3/projects/fd287cccb87f40399334f7070f8957b4/users/0691fb6617c84e01a01052b1a8bb7e32/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.115490 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd287cccb87f40399334f7070f8957b4, user_id=0691fb6617c84e01a01052b1a8bb7e32, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.118187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.131781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1412/2822] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:51 2022] PUT /identity/v3/projects/fd287cccb87f40399334f7070f8957b4/users/0691fb6617c84e01a01052b1a8bb7e32/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:51.142132 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.142390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.142666 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.153858 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:51.176042 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] MFA Rules not processed for user `0691fb6617c84e01a01052b1a8bb7e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:51.177343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:51.241938 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1411/2823] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:51.246508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.308464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83150b-c2da-464d-995f-3949d2857942 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.313337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.313962 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.314267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.314577 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.315215 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.317108 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.344058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1413/2824] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:51 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:51.348727 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.359752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2bc5-b8f4-4b4a-bc7c-86b767000bb3 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.416322 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.416857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.417113 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.417409 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.418037 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.419943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.442690 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1412/2825] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:51 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:51.446710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.457098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc9b00-6744-4b17-be87-6e7cea351c9f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.461699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.462288 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.462565 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.462835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.463471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.465056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.476249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1414/2826] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:51.480435 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.491161 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c71ec-db9e-4d03-ab58-950504fff5a9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.495728 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.496366 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.496646 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.496920 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] PATH_INFO: `/v3/projects/49ed2adb2636421f874c347a189a87ed/users/8a64ef96e7b449dca551603931fcb922/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.511671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ed2adb2636421f874c347a189a87ed, user_id=8a64ef96e7b449dca551603931fcb922, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.514371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.527053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1413/2827] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:51 2022] PUT /identity/v3/projects/49ed2adb2636421f874c347a189a87ed/users/8a64ef96e7b449dca551603931fcb922/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:51.531154 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.541569 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74ca76-31ef-4aa4-b0d0-9c2df263731a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.574793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:51.601173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fccaa2-908e-4996-87ca-1470d2d5856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.601801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fccaa2-908e-4996-87ca-1470d2d5856b admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.602075 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fccaa2-908e-4996-87ca-1470d2d5856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.602344 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fccaa2-908e-4996-87ca-1470d2d5856b admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.602975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fccaa2-908e-4996-87ca-1470d2d5856b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.604556 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fccaa2-908e-4996-87ca-1470d2d5856b admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.614912 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1415/2828] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:51.619323 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.629586 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867608f4-7b54-44e1-995d-f60015cb2a6d admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.634229 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.634881 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.635158 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.635428 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] PATH_INFO: `/v3/projects/49ed2adb2636421f874c347a189a87ed/users/8a64ef96e7b449dca551603931fcb922/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.637377 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ed2adb2636421f874c347a189a87ed, user_id=8a64ef96e7b449dca551603931fcb922, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.640029 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.652679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1414/2829] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:51 2022] PUT /identity/v3/projects/49ed2adb2636421f874c347a189a87ed/users/8a64ef96e7b449dca551603931fcb922/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:51.729422 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.729661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.729881 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.758043 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] MFA Rules not processed for user `8a64ef96e7b449dca551603931fcb922`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:51.759258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:51.827299 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1416/2830] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:51.839394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:51.841196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:51.897260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:51.903605 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50051e4-cfb8-49b5-95b4-be474ef7adfd admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:51.907470 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:51.908071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:51.908962 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:51.909228 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:51.918156 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:51.919574 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:51.928850 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1415/2831] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:51 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:52.008445 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:52.019558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3097bc-771a-4b9f-b503-bd87bd3b6bd2 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:52.023480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703ad55-d4d3-4fe5-b1a8-89a859ea5930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:52.024138 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703ad55-d4d3-4fe5-b1a8-89a859ea5930 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:52.024447 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703ad55-d4d3-4fe5-b1a8-89a859ea5930 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:52.024780 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703ad55-d4d3-4fe5-b1a8-89a859ea5930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:52.087136 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703ad55-d4d3-4fe5-b1a8-89a859ea5930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:52.088733 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8703ad55-d4d3-4fe5-b1a8-89a859ea5930 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:52.097841 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1417/2832] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:54.825298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:54.887778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dab81-6015-421f-b881-09c42018d6ff service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:54.892375 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:54.893021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:54.893300 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:54.893599 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] PATH_INFO: `/v3/users/0691fb6617c84e01a01052b1a8bb7e32` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:54.894712 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0691fb6617c84e01a01052b1a8bb7e32)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:54.896635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:54.945344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0691fb6617c84e01a01052b1a8bb7e32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:54.952442 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0691fb6617c84e01a01052b1a8bb7e32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:54.964679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0691fb6617c84e01a01052b1a8bb7e32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:54.965285 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0691fb6617c84e01a01052b1a8bb7e32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:54.965916 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0691fb6617c84e01a01052b1a8bb7e32'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:54.980178 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1416/2833] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:54 2022] DELETE /identity/v3/users/0691fb6617c84e01a01052b1a8bb7e32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:54.984671 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:54.985375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:54.985375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:55.006146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:55.007346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:55.055013 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:55.066856 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1418/2834] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:55.076665 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:55.078061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:55.135441 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53569646-4024-4471-af46-c34ac5ace872 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:55.139149 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:55.139754 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:55.140032 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:55.140304 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:55.150939 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:55.152389 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:55.163072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1417/2835] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:55.458293 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:55.459888 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:55.473803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b657fa7-7076-49d0-b09e-78d6a379ab53 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:55.478574 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:55.479242 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:55.479526 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:55.479793 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] PATH_INFO: `/v3/projects/fd287cccb87f40399334f7070f8957b4` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:55.480928 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd287cccb87f40399334f7070f8957b4)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:55.482855 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:55.529911 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd287cccb87f40399334f7070f8957b4', 'request_id': 'req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.538107 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd287cccb87f40399334f7070f8957b4', 'request_id': 'req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.544384 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd287cccb87f40399334f7070f8957b4', 'request_id': 'req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.555635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] The token cache is being invalidate because project fd287cccb87f40399334f7070f8957b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:55.555916 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.556567 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.558061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1419/2836] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:55 2022] DELETE /identity/v3/projects/fd287cccb87f40399334f7070f8957b4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:55.562264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:55.572243 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0fa06-3d31-4463-926c-8644036d8c37 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:55.582009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:55.633267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:55.633930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:55.634208 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:55.634481 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] PATH_INFO: `/v3/users/8a64ef96e7b449dca551603931fcb922` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:55.635602 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a64ef96e7b449dca551603931fcb922)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:55.637552 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:55.693933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a64ef96e7b449dca551603931fcb922'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.701102 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a64ef96e7b449dca551603931fcb922'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.713935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a64ef96e7b449dca551603931fcb922'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.714615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a64ef96e7b449dca551603931fcb922'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.715221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0447481d-b668-4576-91cc-74a864a7ebb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a64ef96e7b449dca551603931fcb922'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:55.729050 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1418/2837] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:51:55 2022] DELETE /identity/v3/users/8a64ef96e7b449dca551603931fcb922 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:55.999321 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.000892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:56.014579 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df87c6-ff0d-4b7e-bcc2-9acb934f8e1f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.072432 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.073058 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.073415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.073635 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] PATH_INFO: `/v3/projects/49ed2adb2636421f874c347a189a87ed` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.074739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ed2adb2636421f874c347a189a87ed)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.076621 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.122863 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ed2adb2636421f874c347a189a87ed', 'request_id': 'req-2a56778c-c1d9-4575-b5a1-452aee38455a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:56.130749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ed2adb2636421f874c347a189a87ed', 'request_id': 'req-2a56778c-c1d9-4575-b5a1-452aee38455a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:56.136342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ed2adb2636421f874c347a189a87ed', 'request_id': 'req-2a56778c-c1d9-4575-b5a1-452aee38455a'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:56.147537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] The token cache is being invalidate because project 49ed2adb2636421f874c347a189a87ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:51:56.148004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:56.148666 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-2a56778c-c1d9-4575-b5a1-452aee38455a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:51:56.150394 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1420/2838] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:51:55 2022] DELETE /identity/v3/projects/49ed2adb2636421f874c347a189a87ed => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:56.154994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.155412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.155523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.175859 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:56.177081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:56.237252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1419/2839] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:56.244950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.245229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.245530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.265608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:56.266803 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:56.275061 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1421/2840] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:56.279443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.289535 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ce9ed-d383-4a77-a49e-4c4e17267b3b None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.294138 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.294732 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.295011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.295283 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.295930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:51:56.296234 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.297907 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.309973 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1420/2841] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:51:56.314285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.319443 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:56.326235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5df49a-47e3-48e7-a45a-72a027aaf8db None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.331999 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.332600 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.332907 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.333173 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.333835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.335722 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.362945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1422/2842] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:56.367186 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.377892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd9387-0371-4685-8360-87e4ae9befa4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.389799 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:56.434370 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.434968 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.435241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.435504 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.436129 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.438061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.458758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1421/2843] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:56.463645 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.474217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8dc4a-a9b0-47e9-8bd7-14d1d875c1a8 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.478872 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.479468 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.479749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.480019 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.480658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.482283 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.492703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1423/2844] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:51:56.497190 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.508756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0530-8b5e-4359-9e28-1893a7b50ef9 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.513483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f5e244-2d7a-4586-95a5-07bdd5838aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.514075 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e244-2d7a-4586-95a5-07bdd5838aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.514356 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e244-2d7a-4586-95a5-07bdd5838aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.514631 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f5e244-2d7a-4586-95a5-07bdd5838aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.515270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e244-2d7a-4586-95a5-07bdd5838aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.516868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f5e244-2d7a-4586-95a5-07bdd5838aa9 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.527627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1422/2845] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:56.531699 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.542308 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2fec3e-f59b-46ed-a828-ea5969a14746 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.546966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.547608 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.547889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.548161 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] PATH_INFO: `/v3/projects/6d7c35047b4b4c66811d19895f85b621/users/1f75a2b1d7444758bc66339804e68d4f/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.563546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d7c35047b4b4c66811d19895f85b621, user_id=1f75a2b1d7444758bc66339804e68d4f, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.566285 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.580195 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1424/2846] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:56 2022] PUT /identity/v3/projects/6d7c35047b4b4c66811d19895f85b621/users/1f75a2b1d7444758bc66339804e68d4f/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:56.590689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.590972 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.591251 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.621584 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] MFA Rules not processed for user `1f75a2b1d7444758bc66339804e68d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:56.622809 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:56.690454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1423/2847] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:51:56.696358 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.764050 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d0d6c-3382-437e-9c9f-557a96318839 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.769749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.770552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.770909 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.771181 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.771868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.774157 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.802057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1425/2848] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:56.806289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.817001 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b81d69-2ab6-4a51-9886-8581e947061d None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.878996 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.879600 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.879871 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.880134 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.880776 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.882699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.906444 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1424/2849] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:51:56 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:51:56.909620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.919772 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917fcfed-664b-4e8d-ba93-dac97f8b7921 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.924319 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.924910 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.925183 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.925481 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.926115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.927691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.938648 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1426/2850] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:56.943023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:56.953120 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687daf6-1ba7-4a07-a073-3d4b69769269 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:56.958617 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:56.959266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:56.959549 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:56.959822 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] PATH_INFO: `/v3/projects/f99533fa0f96414581dc6ddda7b8f6dd/users/3e9e8ef2f02b46f0bfe6344e93a0d56b/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:56.972655 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:56.976078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99533fa0f96414581dc6ddda7b8f6dd, user_id=3e9e8ef2f02b46f0bfe6344e93a0d56b, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:56.979730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:56.993288 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1425/2851] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:56 2022] PUT /identity/v3/projects/f99533fa0f96414581dc6ddda7b8f6dd/users/3e9e8ef2f02b46f0bfe6344e93a0d56b/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:56.997194 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:57.007127 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6538f02-1b4f-46cc-868e-60302a51eecb admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:57.078266 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48110728-5521-4bff-8044-5f8e562dda88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:57.078877 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48110728-5521-4bff-8044-5f8e562dda88 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:57.079153 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48110728-5521-4bff-8044-5f8e562dda88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:57.079427 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48110728-5521-4bff-8044-5f8e562dda88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:57.080617 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48110728-5521-4bff-8044-5f8e562dda88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:57.082871 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48110728-5521-4bff-8044-5f8e562dda88 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:57.093057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1427/2852] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:51:57.099699 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:57.111117 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f55be1-9f88-4e82-b25d-b383043f4aa4 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:57.115868 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:57.116518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:57.116797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:57.117068 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] PATH_INFO: `/v3/projects/f99533fa0f96414581dc6ddda7b8f6dd/users/3e9e8ef2f02b46f0bfe6344e93a0d56b/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:57.119053 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99533fa0f96414581dc6ddda7b8f6dd, user_id=3e9e8ef2f02b46f0bfe6344e93a0d56b, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:57.121742 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:57.132813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1426/2853] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:51:57 2022] PUT /identity/v3/projects/f99533fa0f96414581dc6ddda7b8f6dd/users/3e9e8ef2f02b46f0bfe6344e93a0d56b/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:51:57.145198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:57.145529 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:57.145804 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:57.173899 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] MFA Rules not processed for user `3e9e8ef2f02b46f0bfe6344e93a0d56b`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:51:57.175174 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:57.179113 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:51:57.246282 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1428/2854] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:51:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:51:57.257986 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:57.259818 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:51:57.318342 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e6f7-745a-45de-ac22-be7209cfe79c admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:57.322030 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:57.322632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:57.322911 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:57.323180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:57.333241 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:57.334709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:57.344121 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1427/2855] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:51:57.435349 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:51:57.445642 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee1476-88e5-4f82-a146-397649ad6d5a None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:51:57.449164 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49bbd6-5d68-4b2f-9ea1-4ddee11e2792 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:51:57.449788 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bbd6-5d68-4b2f-9ea1-4ddee11e2792 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:51:57.450065 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bbd6-5d68-4b2f-9ea1-4ddee11e2792 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:51:57.450338 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49bbd6-5d68-4b2f-9ea1-4ddee11e2792 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:51:57.507130 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bbd6-5d68-4b2f-9ea1-4ddee11e2792 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:51:57.508706 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49bbd6-5d68-4b2f-9ea1-4ddee11e2792 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:51:57.518535 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1429/2856] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:51:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:02.223884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:02.287296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da88a1-a32e-40e1-9384-3568ad1b6bd0 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:02.292211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:02.292841 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:02.293116 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:02.293420 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] PATH_INFO: `/v3/users/1f75a2b1d7444758bc66339804e68d4f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:02.294550 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f75a2b1d7444758bc66339804e68d4f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:02.296480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:02.342009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f75a2b1d7444758bc66339804e68d4f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.349537 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f75a2b1d7444758bc66339804e68d4f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.361168 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f75a2b1d7444758bc66339804e68d4f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.361925 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f75a2b1d7444758bc66339804e68d4f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.362546 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f75a2b1d7444758bc66339804e68d4f'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.372410 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:02.377509 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1428/2857] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:52:02 2022] DELETE /identity/v3/users/1f75a2b1d7444758bc66339804e68d4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:02.382120 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:02.382637 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:02.382725 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:02.401937 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:02.403147 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:02.461930 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1430/2858] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 29 23:52:02.472279 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:02.473758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:02.530493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98026b-9562-47b1-9b0d-3c755d93eeb0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:02.534252 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:02.534856 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:02.535139 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:02.535413 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:02.544593 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:02.546055 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:02.555456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1429/2859] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:02.849375 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:02.851186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:02.875955 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df13f7-5ef4-4e03-93f7-cdbf9ddb42aa None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:02.884680 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:02.885545 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:02.885886 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:02.886178 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] PATH_INFO: `/v3/projects/6d7c35047b4b4c66811d19895f85b621` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:02.887480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d7c35047b4b4c66811d19895f85b621)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:02.889828 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:02.927022 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:02.937716 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d7c35047b4b4c66811d19895f85b621', 'request_id': 'req-1a430457-6e5e-455f-ac75-24417937fb4e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.945609 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d7c35047b4b4c66811d19895f85b621', 'request_id': 'req-1a430457-6e5e-455f-ac75-24417937fb4e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.951462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d7c35047b4b4c66811d19895f85b621', 'request_id': 'req-1a430457-6e5e-455f-ac75-24417937fb4e'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.962892 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] The token cache is being invalidate because project 6d7c35047b4b4c66811d19895f85b621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:52:02.963171 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.963806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:02.965290 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1431/2860] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:52:02 2022] DELETE /identity/v3/projects/6d7c35047b4b4c66811d19895f85b621 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:02.969281 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:02.979047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38819c3f-8452-4a33-887e-4d5d26c8c40e service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.035556 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.036173 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.036452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.036721 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] PATH_INFO: `/v3/users/3e9e8ef2f02b46f0bfe6344e93a0d56b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.037866 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e9e8ef2f02b46f0bfe6344e93a0d56b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.039773 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.085232 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e9e8ef2f02b46f0bfe6344e93a0d56b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.092239 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e9e8ef2f02b46f0bfe6344e93a0d56b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.103958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e9e8ef2f02b46f0bfe6344e93a0d56b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.104628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e9e8ef2f02b46f0bfe6344e93a0d56b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.105242 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-55dcacdc-b9ae-4381-8c63-f65fe8d915e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e9e8ef2f02b46f0bfe6344e93a0d56b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.118401 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1430/2861] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:52:02 2022] DELETE /identity/v3/users/3e9e8ef2f02b46f0bfe6344e93a0d56b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:03.405029 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.406491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:03.423560 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a430457-6e5e-455f-ac75-24417937fb4e admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.485210 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.485878 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.486159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.487026 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] PATH_INFO: `/v3/projects/f99533fa0f96414581dc6ddda7b8f6dd` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.488167 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99533fa0f96414581dc6ddda7b8f6dd)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.490170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.549707 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99533fa0f96414581dc6ddda7b8f6dd', 'request_id': 'req-bb433391-6df8-4831-8d4d-895b24dfc369'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.557398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99533fa0f96414581dc6ddda7b8f6dd', 'request_id': 'req-bb433391-6df8-4831-8d4d-895b24dfc369'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.563091 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99533fa0f96414581dc6ddda7b8f6dd', 'request_id': 'req-bb433391-6df8-4831-8d4d-895b24dfc369'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.575187 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] The token cache is being invalidate because project f99533fa0f96414581dc6ddda7b8f6dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:52:03.575525 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.576431 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bb433391-6df8-4831-8d4d-895b24dfc369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:03.578007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1432/2862] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:52:03 2022] DELETE /identity/v3/projects/f99533fa0f96414581dc6ddda7b8f6dd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:03.583493 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.584289 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.584487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.604260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:03.605520 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:03.622698 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:03.665903 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1431/2863] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:03.673782 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.674092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.674372 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.693959 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:03.695168 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:03.703260 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1433/2864] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:03.708221 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.717934 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7026ef5-6f74-4d22-b551-5879f29499ec None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.723058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.723654 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.723929 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.724240 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.724834 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:52:03.725135 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.726764 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.738539 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1432/2865] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:52:03.742868 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.752265 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882cdf2-93d3-4cd6-b785-9eb02027e50e None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.756908 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.757542 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.757827 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.758098 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.758727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.760639 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.789861 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1434/2866] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:52:03 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:03.794395 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.804613 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5e44e-caf2-4b62-964e-197d0bbc4681 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.860627 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.861256 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.861568 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.861839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.862464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.864468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.886316 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1433/2867] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:52:03 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:03.890449 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.901779 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aca0c-2618-4f0c-9719-c4cb25a2565a admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.906217 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.906809 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.907085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.907355 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.908020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.910295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.920498 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1435/2868] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:52:03.924514 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.934531 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb82666-ae08-4573-a8dc-8730c0726ae3 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.939155 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e395e63-b1df-4355-9b52-7e920dd5f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.939824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395e63-b1df-4355-9b52-7e920dd5f79a admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.940101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395e63-b1df-4355-9b52-7e920dd5f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.940369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e395e63-b1df-4355-9b52-7e920dd5f79a admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.941007 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395e63-b1df-4355-9b52-7e920dd5f79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.942693 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e395e63-b1df-4355-9b52-7e920dd5f79a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:03.953226 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1434/2869] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:03.958080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:03.967866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855bc2d0-8f7f-4b05-9b56-0c3657651ba5 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:03.973062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:03.973726 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:03.974007 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:03.974286 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] PATH_INFO: `/v3/projects/d09c53c62d794e02b66075e126868949/users/466d28727b834522b2bad0d0ad234667/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:03.985198 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:03.990185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09c53c62d794e02b66075e126868949, user_id=466d28727b834522b2bad0d0ad234667, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:03.993009 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.006935 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1436/2870] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:03 2022] PUT /identity/v3/projects/d09c53c62d794e02b66075e126868949/users/466d28727b834522b2bad0d0ad234667/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:04.019005 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.019321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.019595 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.049434 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] MFA Rules not processed for user `466d28727b834522b2bad0d0ad234667`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:04.050761 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:04.114994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1435/2871] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:04.119543 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.181744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80c400-b78d-4479-9dd6-9dd968a6bd0c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.186309 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.186914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.187196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.187471 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.188094 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.190530 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.217517 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1437/2872] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:52:04 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:04.221783 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.232431 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56b09-793e-431f-be78-b324b86878a4 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.244596 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:04.290211 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.290817 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.291097 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.291369 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.292009 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.293966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.316041 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1436/2873] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:52:04 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:04.320052 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.330994 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee83272-234c-4df8-9568-730a3abf1c59 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.335866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.336464 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.336742 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.337010 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.337679 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.339271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.349732 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1438/2874] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 29 23:52:04.353940 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.364196 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0164e-f4c8-4ded-bcf3-e7d4f5d9dcc2 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.368678 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.369339 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.369657 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.369933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] PATH_INFO: `/v3/projects/07a9f85443a94050945e7eb442689f7c/users/4902f559d6bc45d7b5f1036eadfa9ba5/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.386192 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a9f85443a94050945e7eb442689f7c, user_id=4902f559d6bc45d7b5f1036eadfa9ba5, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.388853 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.401951 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1437/2875] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:04 2022] PUT /identity/v3/projects/07a9f85443a94050945e7eb442689f7c/users/4902f559d6bc45d7b5f1036eadfa9ba5/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:04.405953 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.416346 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490d253-d3c4-4e88-a24f-826e1a05052f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.472918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae197c0-be8f-40fa-bfc8-0c74b0d10047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.473462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae197c0-be8f-40fa-bfc8-0c74b0d10047 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.473738 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae197c0-be8f-40fa-bfc8-0c74b0d10047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.474004 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae197c0-be8f-40fa-bfc8-0c74b0d10047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.474630 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae197c0-be8f-40fa-bfc8-0c74b0d10047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.476202 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae197c0-be8f-40fa-bfc8-0c74b0d10047 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.485713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1439/2876] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:04.490684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.500746 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2acb5-c36b-4129-a0b1-55118f2238b7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.506159 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.506797 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.507064 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.507333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] PATH_INFO: `/v3/projects/07a9f85443a94050945e7eb442689f7c/users/4902f559d6bc45d7b5f1036eadfa9ba5/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.509207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a9f85443a94050945e7eb442689f7c, user_id=4902f559d6bc45d7b5f1036eadfa9ba5, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.511847 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.521905 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1438/2877] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:04 2022] PUT /identity/v3/projects/07a9f85443a94050945e7eb442689f7c/users/4902f559d6bc45d7b5f1036eadfa9ba5/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:04.532056 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.532342 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.532616 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.561491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] MFA Rules not processed for user `4902f559d6bc45d7b5f1036eadfa9ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:04.562698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:04.609257 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:04.632313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1440/2878] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:04.643935 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.645794 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:04.703948 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23afb3-9472-4236-b8ef-8d7dd8a51b53 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.707896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.708498 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.708778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.709049 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.718023 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.719455 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.728778 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1439/2879] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:04.805484 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:04.815268 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321f62-f6b2-46e0-ac20-549db661d31c None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:04.819736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde2940-3c11-41f1-9fc1-c658dfafa087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '573e64b25ae04a47aa757ba787fc850e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:04.820341 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde2940-3c11-41f1-9fc1-c658dfafa087 service cinder] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:04.820622 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde2940-3c11-41f1-9fc1-c658dfafa087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:04.820897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde2940-3c11-41f1-9fc1-c658dfafa087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:04.880581 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde2940-3c11-41f1-9fc1-c658dfafa087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:04.882055 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde2940-3c11-41f1-9fc1-c658dfafa087 service cinder] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:04.890897 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1441/2880] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:05.162463 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:05.224679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d930b7-9d6d-4448-99da-2d3883e9a9e5 service cinder] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:05.229150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:05.229752 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:05.230014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:05.230278 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] PATH_INFO: `/v3/users/466d28727b834522b2bad0d0ad234667` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:05.231372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=466d28727b834522b2bad0d0ad234667)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:05.233272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:05.246775 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:05.280469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466d28727b834522b2bad0d0ad234667'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.288343 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466d28727b834522b2bad0d0ad234667'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.300930 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466d28727b834522b2bad0d0ad234667'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.301640 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466d28727b834522b2bad0d0ad234667'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.302266 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466d28727b834522b2bad0d0ad234667'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.314726 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1440/2881] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:52:05 2022] DELETE /identity/v3/users/466d28727b834522b2bad0d0ad234667 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:05.319350 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:05.319640 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:05.319920 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:05.339656 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:05.340854 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:05.398800 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1442/2882] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:05.409341 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:05.410789 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:05.467952 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db4b50-4b8b-454d-bdac-ba44f8e4c4d0 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:05.472204 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:05.472807 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:05.473084 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:05.473365 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:05.482396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:05.483762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:05.493312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1441/2883] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:05.758379 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:05.760018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:05.774975 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ff348-1082-4829-a97a-42aeb0e6e3b0 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:05.780710 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:05.781674 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:05.782020 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:05.782362 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] PATH_INFO: `/v3/projects/d09c53c62d794e02b66075e126868949` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:05.783961 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09c53c62d794e02b66075e126868949)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:05.786415 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:05.834340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09c53c62d794e02b66075e126868949', 'request_id': 'req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.842311 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09c53c62d794e02b66075e126868949', 'request_id': 'req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.848048 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09c53c62d794e02b66075e126868949', 'request_id': 'req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.859054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] The token cache is being invalidate because project d09c53c62d794e02b66075e126868949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:52:05.859340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.859966 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.862018 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1443/2884] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:52:05 2022] DELETE /identity/v3/projects/d09c53c62d794e02b66075e126868949 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:52:05.866104 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:05.876390 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0f223-ab36-454d-bcbf-b2f3944d42b5 service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:05.933372 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:05.934014 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:05.934296 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:05.934572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] PATH_INFO: `/v3/users/4902f559d6bc45d7b5f1036eadfa9ba5` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:05.935687 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4902f559d6bc45d7b5f1036eadfa9ba5)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:05.937637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:05.979456 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:05.989838 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4902f559d6bc45d7b5f1036eadfa9ba5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:05.997338 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4902f559d6bc45d7b5f1036eadfa9ba5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.009896 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4902f559d6bc45d7b5f1036eadfa9ba5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.010499 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4902f559d6bc45d7b5f1036eadfa9ba5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.011095 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-0fa4c12a-9003-45ef-9ece-7577bcc7ce8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4902f559d6bc45d7b5f1036eadfa9ba5'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.023833 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1442/2885] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:52:05 2022] DELETE /identity/v3/users/4902f559d6bc45d7b5f1036eadfa9ba5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:06.301537 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.303197 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:06.316462 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2ed0-97f1-4007-81d0-bcd063c495fc admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.320196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:06.375483 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.376115 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.376401 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.376664 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] PATH_INFO: `/v3/projects/07a9f85443a94050945e7eb442689f7c` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.377808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a9f85443a94050945e7eb442689f7c)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.379691 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.426303 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a9f85443a94050945e7eb442689f7c', 'request_id': 'req-1027f789-f54c-4baf-8c74-71ae3b4c9923'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.433649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a9f85443a94050945e7eb442689f7c', 'request_id': 'req-1027f789-f54c-4baf-8c74-71ae3b4c9923'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.439544 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a9f85443a94050945e7eb442689f7c', 'request_id': 'req-1027f789-f54c-4baf-8c74-71ae3b4c9923'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.450480 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] The token cache is being invalidate because project 07a9f85443a94050945e7eb442689f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:52:06.450797 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.451438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-1027f789-f54c-4baf-8c74-71ae3b4c9923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:06.452934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1444/2886] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:52:06 2022] DELETE /identity/v3/projects/07a9f85443a94050945e7eb442689f7c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:06.458160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.458476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.458753 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.478603 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:06.479837 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:06.537829 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1443/2887] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:06.545651 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.545913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.546239 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.566692 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:06.567894 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:06.577078 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1445/2888] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:06.581394 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.591483 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014458cd-f78a-497d-8a15-c53ad9e77bea None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.596559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.597147 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.597459 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.597730 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.598371 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:52:06.598679 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.600267 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.612443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1444/2889] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:52:06.616927 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.626258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc270b-6e17-40f4-adff-515d63cabda6 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.631045 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.631644 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.631918 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.632185 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.632823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.634774 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.662374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1446/2890] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:52:06 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:06.666632 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.677297 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4345b7-c121-43e9-8823-4296531ee969 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.734298 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.734898 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.735180 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.735450 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.736081 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.738076 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.759060 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1445/2891] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:52:06 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:06.764066 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.775406 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd5baf-9317-48c3-ba1f-4798e76107f0 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.780728 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.781337 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.781646 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.781915 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.782558 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.784883 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.795968 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1447/2892] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:06.800058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.810325 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403fac-e135-41ec-900f-1270dff059d7 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.814965 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f9834-40cf-4659-b83f-4b33d0a626ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.815559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f9834-40cf-4659-b83f-4b33d0a626ef admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.815839 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f9834-40cf-4659-b83f-4b33d0a626ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.816114 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f9834-40cf-4659-b83f-4b33d0a626ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.816758 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f9834-40cf-4659-b83f-4b33d0a626ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.818396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f9834-40cf-4659-b83f-4b33d0a626ef admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.829200 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1446/2893] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:06.834166 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:06.844276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9927f-3891-4eed-8b51-4e6257d048f7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:06.849744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:06.850395 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.850676 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.850951 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] PATH_INFO: `/v3/projects/fbec7d58c83d4af58a72656b8e47dbbf/users/4aa5740ff9b146a188746ff7ff0d067e/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.866374 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbec7d58c83d4af58a72656b8e47dbbf, user_id=4aa5740ff9b146a188746ff7ff0d067e, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:06.869053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:06.883279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1448/2894] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:06 2022] PUT /identity/v3/projects/fbec7d58c83d4af58a72656b8e47dbbf/users/4aa5740ff9b146a188746ff7ff0d067e/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:06.895473 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:06.895994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:06.895994 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:06.926078 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] MFA Rules not processed for user `4aa5740ff9b146a188746ff7ff0d067e`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:06.927318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:06.935476 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:06.992860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1447/2895] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:07.005206 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:07.006905 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:07.042866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:07.069312 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c661d6-0d88-4ddf-ac64-911a7719e5f7 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:07.073068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a419dfe-a02b-49a2-974c-9da60fcdd95f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:07.073701 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a419dfe-a02b-49a2-974c-9da60fcdd95f service glance] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:07.073976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a419dfe-a02b-49a2-974c-9da60fcdd95f service glance] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:07.074249 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a419dfe-a02b-49a2-974c-9da60fcdd95f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:07.084518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a419dfe-a02b-49a2-974c-9da60fcdd95f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:07.085976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a419dfe-a02b-49a2-974c-9da60fcdd95f service glance] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:07.094925 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1449/2896] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:16.990109 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=23 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:17.090950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=11 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:29.929430 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:29.991500 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fa96d7-811c-4041-9c83-bb5e2ff981fc None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:29.995943 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:29.996559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:29.996855 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:29.997106 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] PATH_INFO: `/v3/users/4aa5740ff9b146a188746ff7ff0d067e` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:29.998250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa5740ff9b146a188746ff7ff0d067e)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.000171 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.046788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa5740ff9b146a188746ff7ff0d067e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.054061 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa5740ff9b146a188746ff7ff0d067e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.066379 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa5740ff9b146a188746ff7ff0d067e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.067044 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa5740ff9b146a188746ff7ff0d067e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.067645 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa5740ff9b146a188746ff7ff0d067e'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.080464 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1448/2897] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:52:29 2022] DELETE /identity/v3/users/4aa5740ff9b146a188746ff7ff0d067e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:30.085196 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.085744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.085744 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.104318 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:30.105528 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:30.166727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1450/2898] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:30.177016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.178451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:30.235101 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf78023-73f2-46e5-92a5-7e748a089d0a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:30.239270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788666c9-5164-4709-b69f-8bb14ffa0901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:30.239873 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788666c9-5164-4709-b69f-8bb14ffa0901 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.240152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788666c9-5164-4709-b69f-8bb14ffa0901 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.240422 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788666c9-5164-4709-b69f-8bb14ffa0901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.250412 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788666c9-5164-4709-b69f-8bb14ffa0901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.251865 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788666c9-5164-4709-b69f-8bb14ffa0901 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.261830 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1449/2899] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:30.527934 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.529368 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:30.544176 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821cc1-a0a5-41d8-8a2b-3028d6d1fe9b None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:30.548748 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:30.549950 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.550227 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.550495 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] PATH_INFO: `/v3/projects/fbec7d58c83d4af58a72656b8e47dbbf` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.552454 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbec7d58c83d4af58a72656b8e47dbbf)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.554741 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.602287 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbec7d58c83d4af58a72656b8e47dbbf', 'request_id': 'req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.610531 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbec7d58c83d4af58a72656b8e47dbbf', 'request_id': 'req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.616808 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbec7d58c83d4af58a72656b8e47dbbf', 'request_id': 'req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.627786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] The token cache is being invalidate because project fbec7d58c83d4af58a72656b8e47dbbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:52:30.628073 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.628711 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-0a2ea2c7-6434-4fea-a19f-326b4d66f2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:52:30.630301 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1451/2900] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:52:30 2022] DELETE /identity/v3/projects/fbec7d58c83d4af58a72656b8e47dbbf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:30.635344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.635630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.635933 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.655607 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:30.656811 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:30.673959 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:30.717578 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1450/2901] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:30.726143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.726426 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.726696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.745973 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:30.747158 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:30.754839 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1452/2902] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:30.759183 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.769604 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c4341-7705-49a0-821e-6461e5d57c35 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:30.774150 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:30.774740 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.775019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.775290 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.775931 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 29 23:52:30.776230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.777860 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.789570 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1451/2903] 10.222.0.67 () {58 vars in 1153 bytes} [Mon Aug 29 23:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 29 23:52:30.794053 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.804159 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c60141-f8b0-4eec-aaaf-4224929466a5 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:30.808923 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:30.809563 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.809847 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.810116 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.810801 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.812731 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.841657 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1453/2904] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:52:30 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 29 23:52:30.846518 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.856635 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4b1b6-4fa9-41c3-be0a-80f511d763cc admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:30.920255 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:30.920867 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.921152 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.921454 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.922244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.924058 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.950260 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1452/2905] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:52:30 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:30.954403 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.965487 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa964b-75ea-42ec-ba37-54b3a6e3deab admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:30.969980 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:30.970508 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:30.971491 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:30.971763 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:30.972398 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:30.974060 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:30.984323 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1454/2906] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:30.988762 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:30.999650 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d58e84-ec27-482e-ab3b-9e745730974a admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:31.005318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23472b0d-4433-4c90-8590-c04593d3ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:31.006115 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23472b0d-4433-4c90-8590-c04593d3ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:31.006572 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23472b0d-4433-4c90-8590-c04593d3ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:31.007016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23472b0d-4433-4c90-8590-c04593d3ea30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:31.007828 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23472b0d-4433-4c90-8590-c04593d3ea30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:31.009724 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23472b0d-4433-4c90-8590-c04593d3ea30 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:31.021451 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1453/2907] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:31.025939 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:31.036765 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e250ce-86b5-475b-9f22-13432f7f7655 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:31.041568 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:31.042243 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:31.042518 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:31.042786 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] PATH_INFO: `/v3/projects/8b56d393405249618854893f48267b7b/users/e4ae2a42fe204e92be8c40a39b056bb1/roles/d0ec590bde8e414995f352abf7f10ace` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:31.058501 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b56d393405249618854893f48267b7b, user_id=e4ae2a42fe204e92be8c40a39b056bb1, role_id=d0ec590bde8e414995f352abf7f10ace)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:31.061213 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:31.075229 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1455/2908] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:31 2022] PUT /identity/v3/projects/8b56d393405249618854893f48267b7b/users/e4ae2a42fe204e92be8c40a39b056bb1/roles/d0ec590bde8e414995f352abf7f10ace => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:31.080396 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd8f12-d1e7-4383-b175-19162f7db800 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:31.080710 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd8f12-d1e7-4383-b175-19162f7db800 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:31.081024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd8f12-d1e7-4383-b175-19162f7db800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:31.101995 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-f0fd8f12-d1e7-4383-b175-19162f7db800 None None] MFA Rules not processed for user `77a3dd5bae654f599f156f30a08466b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:31.103230 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-f0fd8f12-d1e7-4383-b175-19162f7db800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:31.168344 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1454/2909] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:31.178932 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:31.181201 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:31.203503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:31.242273 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d13ba1-a01a-4b27-ba36-f1c36a1e7e5d admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:31.245946 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:31.246452 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:31.246729 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:31.246996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:31.255914 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:31.257389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:31.266745 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1456/2910] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:35.333947 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.334479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.334479 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.365092 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] MFA Rules not processed for user `e4ae2a42fe204e92be8c40a39b056bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:35.366487 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:35.385576 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:35.441848 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1455/2911] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:35.446546 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:35.456476 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbac62a-edf9-49b7-ae43-304c62b95511 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:35.461433 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:35.462112 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.462276 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.462547 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] PATH_INFO: `/v3/projects` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.463186 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:35.466279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:35.495700 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1457/2912] 10.222.0.67 () {60 vars in 1153 bytes} [Mon Aug 29 23:52:35 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:35.499851 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:35.512133 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027c6fe-7f8f-4dd0-8a80-cb7e3d987c59 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:35.571527 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:35.572136 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.572419 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.572803 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] PATH_INFO: `/v3/users` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.573452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:35.575637 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:35.599883 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1456/2913] 10.222.0.67 () {60 vars in 1144 bytes} [Mon Aug 29 23:52:35 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 29 23:52:35.603620 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:35.615035 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1fa1c-2503-44c7-8d2f-732f0421791f admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:35.619913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:35.620511 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.620791 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.621057 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.621753 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:35.623412 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:35.634983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1458/2914] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:35.639671 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:35.650270 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b02e1-1591-4b6c-ba82-2f1a86befc72 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:35.655287 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:35.656012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.656354 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.656715 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] PATH_INFO: `/v3/projects/2bda54e9a40a427895e8f8efc1d6582c/users/adc525541d8e40f2bb8bb3a1b5387934/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.672187 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bda54e9a40a427895e8f8efc1d6582c, user_id=adc525541d8e40f2bb8bb3a1b5387934, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:35.674958 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:35.688575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1457/2915] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:35 2022] PUT /identity/v3/projects/2bda54e9a40a427895e8f8efc1d6582c/users/adc525541d8e40f2bb8bb3a1b5387934/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:52:35.693031 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:35.702941 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc46f62-9ea9-4574-9328-6f6a2052242c admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:35.762661 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7d1d1-e4d1-4e84-83e3-ac451eba6de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:35.763417 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d1d1-e4d1-4e84-83e3-ac451eba6de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.763698 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d1d1-e4d1-4e84-83e3-ac451eba6de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.764085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7d1d1-e4d1-4e84-83e3-ac451eba6de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.764727 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7d1d1-e4d1-4e84-83e3-ac451eba6de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:35.766340 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7d1d1-e4d1-4e84-83e3-ac451eba6de0 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:35.777510 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1459/2916] 10.222.0.67 () {58 vars in 1122 bytes} [Mon Aug 29 23:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 29 23:52:35.782012 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:35.792577 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07af18-3f89-43a4-b6c3-7308ac277fbf admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:35.797331 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:35.798019 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:35.798302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:35.798575 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] PATH_INFO: `/v3/projects/2bda54e9a40a427895e8f8efc1d6582c/users/adc525541d8e40f2bb8bb3a1b5387934/roles/0c9309017d3143658120ff04160bea6f` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:35.800512 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bda54e9a40a427895e8f8efc1d6582c, user_id=adc525541d8e40f2bb8bb3a1b5387934, role_id=0c9309017d3143658120ff04160bea6f)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:35.803245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:35.815244 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1458/2917] 10.222.0.67 () {60 vars in 1483 bytes} [Mon Aug 29 23:52:35 2022] PUT /identity/v3/projects/2bda54e9a40a427895e8f8efc1d6582c/users/adc525541d8e40f2bb8bb3a1b5387934/roles/0c9309017d3143658120ff04160bea6f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 29 23:52:40.360596 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127883aa-2d33-40ab-9e77-6bcaec1df1fb None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:40.361088 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127883aa-2d33-40ab-9e77-6bcaec1df1fb None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:40.361190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127883aa-2d33-40ab-9e77-6bcaec1df1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:40.394315 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-127883aa-2d33-40ab-9e77-6bcaec1df1fb None None] MFA Rules not processed for user `adc525541d8e40f2bb8bb3a1b5387934`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:40.395615 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-127883aa-2d33-40ab-9e77-6bcaec1df1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:40.474683 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1460/2918] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:40.487480 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:40.489259 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:40.579885 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9c094-c642-4773-9f24-dfacb5a8b151 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:40.583863 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b8d3f2d7323411d81303f472a16d562', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:40.584443 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:40.584749 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:40.585025 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:40.589523 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:40.646936 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:40.648368 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:40.657207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1459/2919] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:40.776696 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea51dc-94fc-4f63-935a-9abc94138237 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:40.776979 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea51dc-94fc-4f63-935a-9abc94138237 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:40.777279 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea51dc-94fc-4f63-935a-9abc94138237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:40.795295 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:40.843713 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-75ea51dc-94fc-4f63-935a-9abc94138237 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:40.844947 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-75ea51dc-94fc-4f63-935a-9abc94138237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:40.909971 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1461/2920] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:52:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:40.955824 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:40.957264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:41.049468 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977651f-82c2-41b1-b01f-b58ae8236908 service glance] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:41.054449 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:41.055047 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:41.055857 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:41.056127 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:41.064160 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:41.065812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:41.073812 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1460/2921] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:52:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:52:49.538649 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] REQUEST_METHOD: `POST` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:49.539258 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:49.539533 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:49.567080 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.auth.core [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] MFA Rules not processed for user `e4ae2a42fe204e92be8c40a39b056bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:49.568838 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:49.577655 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1462/2922] 10.222.0.67 () {58 vars in 958 bytes} [Mon Aug 29 23:52:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:49.848021 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:49.910291 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed0969-a81f-4f54-af50-dfc23e24e6ac service swift] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:49.914813 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:49.915433 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:49.915733 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:49.916022 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:49.917988 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:49.929015 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:49.930519 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e14ad2-b01d-4fe9-a401-1c608f851930 service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:49.938714 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1461/2923] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:50.271739 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:50.273232 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:50.353865 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463503e-d387-4818-82fe-5ffb9b717429 None None] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:50.358819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:50.359424 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:50.359703 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:50.359974 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:50.361816 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:50.373160 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:50.374764 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:50.384832 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1463/2924] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:52:51.815505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:51.816011 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:51.816237 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:51.837633 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:52:51.838912 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:51.847080 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1462/2925] 10.222.0.67 () {58 vars in 1009 bytes} [Mon Aug 29 23:52:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:52:51.859143 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:51.871749 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d8fe-9373-4e6c-b174-66dd3222b5ff service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:51.876976 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:51.877631 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:51.877913 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:51.878190 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:51.888829 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:51.890534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:51.899781 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1464/2926] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:52:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:52:59.951823 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:52:59.965559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aae79f-8cf9-488d-98a9-542449e5567e None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:52:59.969098 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:52:59.969739 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:52:59.970028 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:52:59.970321 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:52:59.973629 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:52:59.984849 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:52:59.987469 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:52:59.990891 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=100 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:52:59.997392 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1463/2927] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:52:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:00.566364 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:53:00.568170 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:53:00.623333 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=100 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:00.652590 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0bbe4-be6b-480c-b3c7-248bb90c52fc service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:53:00.658325 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:53:00.658945 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:53:00.659230 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:53:00.659506 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:53:00.661263 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:53:00.674453 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:53:00.676062 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:53:00.686864 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1465/2928] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:53:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:06.244892 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:53:06.259719 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc324b3e-1b64-4fa5-a878-44f1d89634ae service neutron] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:53:06.265416 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:53:06.266024 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:53:06.266332 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:53:06.266649 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:53:06.268559 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:53:06.281709 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:53:06.283816 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:53:06.294894 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1464/2929] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:53:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:10.682219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=14 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:13.097219 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:53:13.106754 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed874125-2764-4e8e-8fdb-ba9c51248c9b service nova] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:53:13.110389 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0b4196792fe44f2a8fb31bba5a6006e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:53:13.110983 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:53:13.111262 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:53:13.111562 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:53:13.120502 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:53:13.121889 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:53:13.131685 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1466/2930] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:53:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:53:16.290016 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=7 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:53:23.127719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=6 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:40.985245 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:40.986870 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:41.000689 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a49f-fb63-4e3c-8069-fabd4ddd8180 service nova] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:41.007157 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09019a1191eb4b4194c245dff90ef942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:41.007756 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:41.008033 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:41.008308 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:41.010072 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:41.023452 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:41.025045 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de4a924-81e3-49b7-b765-e8b0fa28b2bb service nova] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:41.037238 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1465/2931] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:54:46.307866 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:46.319400 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04e1b1-f69e-4ef6-94ff-c00a169199a5 service neutron] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:46.324438 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:46.324969 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:46.325271 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:46.325552 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:46.327291 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:46.339507 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:46.341086 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:46.351806 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1467/2932] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 29 23:54:47.217427 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] REQUEST_METHOD: `POST` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:47.217902 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:47.218018 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:47.240842 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.auth.core [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] MFA Rules not processed for user `0b901bb69e1941158bc783a5f4c34256`. Rule list: `[]` (Enabled: `True`). {{(pid=81694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 29 23:54:47.242100 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:47.249565 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1466/2933] 10.222.0.67 () {58 vars in 967 bytes} [Mon Aug 29 23:54:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 29 23:54:47.291085 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:47.303071 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e6fa0-88dd-4812-8aa2-92120def8372 service placement] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:47.308146 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8c13a2711f2f4a0dbbc312b7a1b9034b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:47.308736 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] REQUEST_METHOD: `GET` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:47.308996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:47.309259 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:47.317497 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:47.319054 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:47.327151 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1468/2934] 10.222.0.67 () {60 vars in 1384 bytes} [Mon Aug 29 23:54:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 29 23:54:50.770399 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:50.772505 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:50.788207 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec9a44-e672-4c03-aec8-00e86907fec2 None None] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:50.793628 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6548e5f5d9e24b4eadde36b3b8a37882', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1af80d493522441c83c64a8e6cd193fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:50.794235 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] REQUEST_METHOD: `GET` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:50.794513 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:50.794782 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:50.796506 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:50.810684 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:50.812318 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:50.838264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1467/2935] 10.222.0.67 () {60 vars in 1365 bytes} [Mon Aug 29 23:54:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 29 23:54:53.781719 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:53.879148 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44955b-db3a-42da-aa86-44c35ea2f72a service swift] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:53.883858 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:53.884520 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:53.884819 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:53.885074 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] PATH_INFO: `/v3/users/e4ae2a42fe204e92be8c40a39b056bb1` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:53.886252 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ae2a42fe204e92be8c40a39b056bb1)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:53.888322 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:53.936448 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ae2a42fe204e92be8c40a39b056bb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:53.943823 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ae2a42fe204e92be8c40a39b056bb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:53.951208 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ae2a42fe204e92be8c40a39b056bb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:53.951835 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ae2a42fe204e92be8c40a39b056bb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:53.964588 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ae2a42fe204e92be8c40a39b056bb1'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:53.970571 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1469/2936] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:54:53 2022] DELETE /identity/v3/users/e4ae2a42fe204e92be8c40a39b056bb1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:54:54.143415 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:54.155966 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e276f-be8b-4024-8562-2002a1f09b9d service placement] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:54.213989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:54.214615 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:54.214895 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:54.215167 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] PATH_INFO: `/v3/projects/8b56d393405249618854893f48267b7b` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:54.216272 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b56d393405249618854893f48267b7b)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:54.218250 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:54.264893 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b56d393405249618854893f48267b7b', 'request_id': 'req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.272123 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b56d393405249618854893f48267b7b', 'request_id': 'req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.277466 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b56d393405249618854893f48267b7b', 'request_id': 'req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.288983 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] The token cache is being invalidate because project 8b56d393405249618854893f48267b7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:54:54.289302 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.289989 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.291477 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1468/2937] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:54:54 2022] DELETE /identity/v3/projects/8b56d393405249618854893f48267b7b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:54:54.295593 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Authenticating user token {{(pid=81695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:54.296996 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.fernet_utils [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:54.310503 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c8fd1-7719-4d18-a30a-e174bc7e3033 admin admin] Validating token access rules against request {{(pid=81695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:54.370092 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:54.381329 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:54.381991 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:54.382267 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:54.382534 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] PATH_INFO: `/v3/users/adc525541d8e40f2bb8bb3a1b5387934` {{(pid=81695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:54.383658 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc525541d8e40f2bb8bb3a1b5387934)` {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:54.385603 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] RBAC: Authorization granted {{(pid=81695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:54.432235 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc525541d8e40f2bb8bb3a1b5387934'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.439313 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc525541d8e40f2bb8bb3a1b5387934'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.447253 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc525541d8e40f2bb8bb3a1b5387934'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.447954 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc525541d8e40f2bb8bb3a1b5387934'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.460068 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG keystone.notifications [None req-bca7469c-b5ac-4f55-b7a3-f07df4415a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc525541d8e40f2bb8bb3a1b5387934'} {{(pid=81695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.466335 dv-cinder-855041-2-smb devstack@keystone.service[81695]: [pid: 81695|app: 0|req: 1470/2938] 10.222.0.67 () {58 vars in 1224 bytes} [Mon Aug 29 23:54:54 2022] DELETE /identity/v3/users/adc525541d8e40f2bb8bb3a1b5387934 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:54:54.641897 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Authenticating user token {{(pid=81694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 29 23:54:54.643388 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.fernet_utils [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 29 23:54:54.660112 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec97ee-ec1d-46e6-b5dc-b48f8d1ebbe8 admin admin] Validating token access rules against request {{(pid=81694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 29 23:54:54.715788 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:54:54.722502 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77a3dd5bae654f599f156f30a08466b7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fd422d7b4374b2da837eb380d608b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 29 23:54:54.724004 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 29 23:54:54.724333 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 29 23:54:54.724691 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] PATH_INFO: `/v3/projects/2bda54e9a40a427895e8f8efc1d6582c` {{(pid=81694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 29 23:54:54.726071 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bda54e9a40a427895e8f8efc1d6582c)` {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 29 23:54:54.728264 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] RBAC: Authorization granted {{(pid=81694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 29 23:54:54.776790 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bda54e9a40a427895e8f8efc1d6582c', 'request_id': 'req-fb925a4e-f71a-499f-ac67-31e3a50ec12b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.785002 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bda54e9a40a427895e8f8efc1d6582c', 'request_id': 'req-fb925a4e-f71a-499f-ac67-31e3a50ec12b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.791496 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bda54e9a40a427895e8f8efc1d6582c', 'request_id': 'req-fb925a4e-f71a-499f-ac67-31e3a50ec12b'} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.803345 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] The token cache is being invalidate because project 2bda54e9a40a427895e8f8efc1d6582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 29 23:54:54.803630 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.804312 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG keystone.notifications [None req-fb925a4e-f71a-499f-ac67-31e3a50ec12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 29 23:54:54.805884 dv-cinder-855041-2-smb devstack@keystone.service[81694]: [pid: 81694|app: 0|req: 1469/2939] 10.222.0.67 () {58 vars in 1233 bytes} [Mon Aug 29 23:54:54 2022] DELETE /identity/v3/projects/2bda54e9a40a427895e8f8efc1d6582c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 29 23:55:04.462587 dv-cinder-855041-2-smb devstack@keystone.service[81695]: DEBUG dbcounter [-] [81695] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:55:04.799661 dv-cinder-855041-2-smb devstack@keystone.service[81694]: DEBUG dbcounter [-] [81694] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}